-- Logs begin at Tue 2022-10-11 23:31:15 UTC, end at Wed 2022-10-12 00:44:23 UTC. -- Oct 12 00:11:03.248361 dv-cinder-849143-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 00:11:03.256442 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 00:11:03 2022] *** Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: nodename: dv-cinder-849143-13-iscsi Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: machine: x86_64 Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: clock source: unix Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: pcre jit disabled Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: detected number of CPU cores: 4 Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: current working directory: / Oct 12 00:11:03.258426 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: detected binary path: /usr/bin/uwsgi-core Oct 12 00:11:03.259226 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: your processes number limit is 47680 Oct 12 00:11:03.259226 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: your memory page size is 4096 bytes Oct 12 00:11:03.259226 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: detected max file descriptor number: 2048 Oct 12 00:11:03.259226 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: lock engine: pthread robust mutexes Oct 12 00:11:03.259226 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: thunder lock: enabled Oct 12 00:11:03.259226 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 00:11:03.259226 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 00:11:03.298879 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: Python main interpreter initialized at 0x559da58499c0 Oct 12 00:11:03.298879 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: python threads support enabled Oct 12 00:11:03.298879 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: your server socket listen backlog is limited to 100 connections Oct 12 00:11:03.298879 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: your mercy for graceful operations on workers is 90 seconds Oct 12 00:11:03.299235 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 00:11:03.299310 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: *** Operational MODE: preforking *** Oct 12 00:11:03.299579 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: *** uWSGI is running in multiple interpreter mode *** Oct 12 00:11:03.299579 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: spawned uWSGI master process (pid: 110773) Oct 12 00:11:03.299766 dv-cinder-849143-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 12 00:11:03.303413 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: spawned uWSGI worker 1 (pid: 110774, cores: 1) Oct 12 00:11:03.303413 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: spawned uWSGI worker 2 (pid: 110775, cores: 1) Oct 12 00:11:03.303413 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 00:11:03.956134 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 00:11:03.959095 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 00:11:05.036993 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 00:11:05.036993 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: from cryptography.utils import int_from_bytes Oct 12 00:11:05.037614 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 00:11:05.037614 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: from cryptography.utils import int_from_bytes Oct 12 00:11:05.037843 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 00:11:05.037843 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: from cryptography.utils import int_from_bytes Oct 12 00:11:05.038259 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 00:11:05.038259 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: from cryptography.utils import int_from_bytes Oct 12 00:11:07.526712 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 00:11:07.527267 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 00:11:07.527658 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 00:11:07.527752 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 00:11:07.527846 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 00:11:07.527938 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 00:11:07.528016 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 00:11:07.528092 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 00:11:07.528161 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 00:11:07.528241 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 00:11:07.528456 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.528598 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.528779 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.528924 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.529098 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.529246 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.529415 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.529567 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.529740 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.529896 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.530059 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.530209 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.530376 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.530512 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.530687 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.530828 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.531010 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.531152 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.531268 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.531439 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.531607 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.531754 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.531930 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-13-iscsi {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.532079 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-13-iscsi {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.532269 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.532426 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.532580 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.532713 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.532887 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.533028 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.533199 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.533361 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.533505 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.533644 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.533804 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.533962 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.534105 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.534263 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.534596 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.534765 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.535038 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.535150 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.535343 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.535451 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.535678 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.535772 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.536007 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.536099 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.536334 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.536441 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539059 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539193 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539193 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539318 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539318 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539482 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539482 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539613 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539676 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539739 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539810 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-13-iscsi {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539883 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-13-iscsi {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.539948 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540016 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540092 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540164 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540233 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540296 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540359 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540438 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540513 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540578 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540642 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540712 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540777 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540840 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540840 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.540959 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.541024 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.541095 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.541569 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.541808 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.542046 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.542252 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.542252 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.542693 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.542951 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.543164 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.543414 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.543625 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.543854 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.544068 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.544306 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.544507 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.544507 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.544939 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.545179 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.545383 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546044 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546128 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546207 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546296 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546363 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546427 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546489 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546557 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546629 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546708 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546784 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546858 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546924 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.546988 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547060 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547133 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547198 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547262 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547325 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547501 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547573 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547637 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547700 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547763 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.547827 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.548388 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.548457 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.548519 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.548581 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.548644 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.548933 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.549037 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.549152 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.549238 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.549366 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.549451 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.549677 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.549771 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.549988 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.550073 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.550305 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.550388 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.550613 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.550698 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.550925 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.551009 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.551314 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.551421 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.551587 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.551673 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.551891 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.551975 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.552224 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.552307 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.552544 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.552630 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.552843 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.552927 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.553158 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.553242 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.553475 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.553560 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.553778 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.553864 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.554079 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.554172 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.554381 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.554465 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.554696 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.554780 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.555024 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.555116 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.555323 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.555428 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.555593 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.555681 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.555891 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.555988 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.556192 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.556276 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.556503 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.556587 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.556803 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.556896 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.557107 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.557202 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.557408 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.557491 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.557702 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.557794 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.558004 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.558088 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.558304 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.558388 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.558605 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.558696 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.559016 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.559159 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.559286 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.559388 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.559527 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.559615 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.559827 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.559913 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.560128 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.560220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.560428 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.560515 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.560727 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.560812 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.561041 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.561125 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.561353 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.561445 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.561655 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.561740 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.561955 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.562050 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.562256 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.562350 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.562556 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.562652 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.562869 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.562962 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.563169 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.563254 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.563536 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.564154 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.564378 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.564465 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.564687 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.564786 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.564992 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.565077 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.565308 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.565402 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.565615 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.565753 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.565921 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.566010 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.566237 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.566330 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.566534 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.566626 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.566835 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.566919 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.567147 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.567241 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.567474 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.567562 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.567780 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.567875 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.568078 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.568171 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.568377 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.568461 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.568677 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.568762 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.568976 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.569083 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.569279 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.569385 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.569576 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.569668 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.569870 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.569956 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.570182 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.570265 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.570499 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.570582 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.570803 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.570889 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.571104 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.571197 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.571425 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.571515 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.571741 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.571828 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:11:07.572075 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.572158 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.572402 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.572486 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.572742 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.572827 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.573056 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.573153 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.573383 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.573481 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.573711 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.573795 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.574027 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.574111 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.574337 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.574499 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.574651 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.574742 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.574973 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.575057 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.575282 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.575389 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.575616 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.575712 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.575927 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.576015 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.576243 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.576355 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.576562 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.576655 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.576890 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.576975 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.577207 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.577301 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.577520 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.577605 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.577836 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.577920 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.578145 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.578239 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.578462 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.578546 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.578786 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.578878 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.579105 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.579224 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.579466 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.579587 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.579810 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.579922 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.580155 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.580251 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.580465 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.580567 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.580790 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.580885 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.581109 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.581202 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.581417 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.581511 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.581725 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.581831 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.582032 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.582133 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.582369 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.582461 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.582678 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.582784 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.582989 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.583091 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.583301 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.583408 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.583638 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.583739 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.583957 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.584042 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.584267 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.584368 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.584575 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.584670 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.584882 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.584967 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.585190 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.585278 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.585497 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.585594 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.585828 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.585913 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.586137 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.586229 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.586456 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.586542 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.586765 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.586851 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.587073 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.587157 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.587412 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.587503 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.587714 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.587812 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.588021 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.588113 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.588329 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.588434 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.588629 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.588714 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.588928 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.589013 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.589229 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.589316 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.589535 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.589624 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.589839 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.589924 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.590154 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.590247 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.590477 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.590563 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.590781 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.590875 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.591109 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.591194 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.591430 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.591518 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.591741 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.591836 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.592049 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.592133 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.592355 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.592440 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.592656 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.592753 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.592965 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.593051 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.593270 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.593360 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.593571 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.593664 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.593890 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.593974 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.594196 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.594288 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.594496 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.594582 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.594839 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.594938 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.595144 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.595239 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.595470 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.595556 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.595782 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.595866 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.596090 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.596180 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.596399 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.596485 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.596708 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.596792 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.597014 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.597181 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.597331 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.597416 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.597639 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.597725 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.597945 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.598038 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.598275 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.598360 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.598601 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.598685 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.598905 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.598999 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.599230 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.599318 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.599579 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.599686 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.599891 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.599990 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.600192 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.600277 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.600496 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.600588 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.600799 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.600895 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.601098 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.601183 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.601398 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.601483 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.601702 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.601795 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.602002 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.602087 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.602301 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.602386 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.602600 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.602686 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.602900 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.602991 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.603200 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.603285 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.603544 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.603640 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.603852 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.603951 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.604152 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.604247 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.604454 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.604541 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.604754 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.604840 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.605091 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.605193 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.605392 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.605496 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.605730 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.605823 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.606060 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.606155 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.606377 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.606462 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.606694 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.606778 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.607002 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.607103 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.607313 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.607417 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.607647 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.607732 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.607956 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.608058 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.608263 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.608348 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.608570 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.608654 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.608887 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.608973 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.609194 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.609278 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.609509 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.609639 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.609816 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.609905 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.610136 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.610224 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.610970 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.611063 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.611290 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.611433 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.611620 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.611705 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.611934 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.612018 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.612271 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.612358 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.612601 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.612696 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.612916 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.613010 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.613233 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.613318 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.613542 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.613627 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.613853 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.613947 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.614163 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.614248 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.614471 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.614555 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.614781 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.614876 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.615089 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.615174 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.615426 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.615516 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.615737 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.615842 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.616053 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.616184 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.616360 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.616444 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.616677 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.616776 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.616984 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.617077 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.617298 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.617383 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.617597 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.617683 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.617907 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.617999 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.618231 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.618315 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.618560 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.618645 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.618867 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.618951 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.619176 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.619261 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.619517 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.619607 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.619834 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.619931 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.620141 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.620227 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.620448 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.620535 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.620750 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.620835 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.621052 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.621146 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.621361 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.621446 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.621672 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.621767 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.621978 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.622076 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.622286 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.622373 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.622590 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.622676 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.622902 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.622997 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.623213 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.623304 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.623540 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.623628 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.623844 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.623945 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.624152 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.624237 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.624472 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.624557 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.624781 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.624876 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.625100 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.625185 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.625420 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.625551 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.625724 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.625811 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.626080 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.626689 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.626887 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.626988 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.627201 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.627290 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.627532 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.627627 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.627839 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.627933 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.628145 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.628231 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.628486 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.628578 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.628797 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.628890 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.629100 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.629184 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.629414 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.629499 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.629733 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.629826 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.630041 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.630130 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.630351 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.630436 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.630659 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.630753 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.630965 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.631050 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.631282 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.631385 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.631616 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.631714 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.631925 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.632010 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.632233 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.632325 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.632542 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.632629 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.632850 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.632935 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.633158 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.633242 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.633476 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.633562 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.633780 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.633875 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.634087 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.634179 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.634394 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.634480 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.634695 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.634781 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.635001 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.635085 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.635313 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.635426 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.635906 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.635992 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.636234 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.636331 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.636550 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.636635 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.636870 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.636965 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.637210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.637311 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.637527 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.637626 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.637855 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.638225 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.638452 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.638539 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.638763 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.638848 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.639069 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.639156 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.639390 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.639479 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.639704 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.639803 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.640009 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.640111 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.640315 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.640409 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.640617 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.640711 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.640918 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.641003 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.641220 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.641305 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.641530 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.641646 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.641859 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.641945 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.642161 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.642246 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.642463 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.642557 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.642768 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.642853 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.643080 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.643165 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.643397 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.643494 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.643712 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.643798 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.644014 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.644099 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.644335 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.644422 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.644641 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.644726 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.644943 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.645028 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.645243 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.645330 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.645545 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.645629 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.645884 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.645981 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.646185 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.646272 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.646518 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.646612 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.646843 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.646936 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.647178 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.647264 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.647507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.647597 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.647813 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.647907 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.648134 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.648219 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.648435 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.648522 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.648738 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.648835 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.649038 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.649123 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.649344 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.649430 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.649648 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.649742 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.649948 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.650033 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.650254 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.650344 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.650561 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.650648 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.650866 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.650958 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.651170 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.651255 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.651498 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.651587 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.651806 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.651893 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.652104 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.652197 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.652423 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.652510 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.652721 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.652814 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.653021 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.653115 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.653320 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.653406 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.653625 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.653710 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.653929 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.654027 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.654229 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.654319 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.654536 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.654620 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.654837 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.654931 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.655157 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.655263 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.655474 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.655569 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.655776 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.655881 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.656076 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.656163 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.656382 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.656478 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.656687 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.656785 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.656988 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.657073 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.657330 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.657419 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.657638 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.657725 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.657938 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.658024 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.658238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.658323 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.658542 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.658700 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.658840 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.658926 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.659140 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.659278 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.659466 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.659580 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.659788 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.659886 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.660103 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.660212 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.660403 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.660498 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.660706 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.660790 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.661007 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.661099 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.661309 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.661401 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.661610 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.661693 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.661914 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.662006 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.662214 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.662298 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.662514 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.662598 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.662812 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.662903 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.663112 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.663195 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.663432 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.663519 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.663754 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.663852 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.664060 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.664145 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.664361 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.664445 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.664663 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.664760 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.664962 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.665046 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.665300 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.665392 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.665607 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.665758 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.665962 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.666098 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.666266 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.666410 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.666578 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.666715 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.666894 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.667031 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.667205 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.667336 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.667539 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.667626 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.667852 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.667938 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.668158 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.668253 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.668472 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.668560 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.668783 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.668870 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.669094 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.669189 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.669396 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.669482 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.669699 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.669795 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.670019 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.670113 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.670330 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.670424 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.670637 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.670726 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.670955 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.671050 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.671272 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.671357 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.671619 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.671735 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.671923 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.672050 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.672232 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.672544 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.672658 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.673376 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.674352 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.674352 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.674352 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.674573 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.674651 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.674843 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.674941 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.675164 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.675250 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.675494 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.675595 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.675800 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.675901 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.676108 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.676199 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.676416 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.676516 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.676718 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.676814 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.677040 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.677127 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.677346 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.677442 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.677646 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.677733 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.677953 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.678040 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.678255 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.678341 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.678564 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.678651 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.678867 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.678954 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.679171 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.679289 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.679508 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.679626 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.679817 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.679937 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.680128 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.680242 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.680432 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.680550 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.680860 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.680948 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.681173 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.681336 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.681482 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.681567 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.681784 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.681870 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.682096 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.682191 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.682407 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.682493 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.682723 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.682809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.683036 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.683131 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.683341 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.683487 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.683680 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.683766 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.683987 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.684090 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.684309 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.684395 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.684612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.684705 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.684914 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.685008 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.685215 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.685301 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.685533 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.685618 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.685835 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.685922 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.686144 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.686241 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.686452 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.686545 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.686757 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.686844 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.687080 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.687227 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.687393 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.687559 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.687720 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.687860 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.688113 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.688252 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.688425 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.689138 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.689323 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.689471 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.689630 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.689774 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.689936 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.690075 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.690247 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.690347 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.690554 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.690695 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.690875 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.691008 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.691196 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.691347 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.691524 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.691663 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.691841 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.691978 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.692146 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.692367 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.692511 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.692658 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.692793 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.692928 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.693063 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.693206 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.693373 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.693522 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.693704 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.693841 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.694027 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.694172 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.694347 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.694480 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.694659 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.694794 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.694980 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.695114 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.695284 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.695451 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.695628 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.695755 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.695930 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.696036 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.696237 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.696335 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.696539 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.696633 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.696861 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.696948 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.697165 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.697249 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.697476 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.697591 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.697782 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.697868 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.698088 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.698172 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.698393 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.698486 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.698698 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.698782 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.699009 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.699093 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.699313 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.699435 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.699643 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.699729 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.699950 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.700035 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.700255 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.700349 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.700579 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.700675 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.700885 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.700983 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.701203 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.701289 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.701511 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.701594 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.701821 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.701906 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.702126 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.702212 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.702430 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.702515 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.702749 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.702832 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.703059 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.703146 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.703384 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.703478 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.703696 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.703780 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.704002 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.704096 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.704359 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.704442 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.704665 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.704762 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.704986 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.705071 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.705304 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.705387 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.705615 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.705710 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.705930 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.706015 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.706261 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.706413 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.706554 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.706701 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.706837 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.706971 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.707146 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.707286 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.707496 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.707646 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.707791 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.707926 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.708091 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.708246 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.708392 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.708527 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.708685 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.708822 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.708986 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.709131 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.709283 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.709420 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.709576 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.709715 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.709881 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.710027 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.710169 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.710303 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.710470 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.710606 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.710774 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.710915 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.711080 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.711218 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.711402 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.711555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.711731 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.711876 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.712043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.712189 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.712351 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.712490 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.712655 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.712802 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.712961 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.713099 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.713278 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.713416 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.713591 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.713736 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.713906 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.714068 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.714202 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.714336 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.714523 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.714670 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.714838 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.714983 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.715151 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.715288 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.715484 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.715582 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.715800 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.715885 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.716112 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.716195 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.716427 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.716523 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.716741 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.716943 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.717050 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.717272 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.717366 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.717589 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.717735 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.717901 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.718050 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.718213 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.718473 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.718613 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.718804 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.718943 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.719115 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.719264 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.719450 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.719590 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.719781 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.719922 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.720093 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.720251 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.720405 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.720492 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.720716 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.720809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.721033 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.721198 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.721343 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.721431 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.721653 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.721739 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.721969 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.722057 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.722280 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.722367 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.722590 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.722677 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.722922 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.723010 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.723236 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.723323 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.723567 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.723667 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.723879 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.723964 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.724188 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.724281 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.724500 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.724601 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.724813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.724902 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.725123 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.725218 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.725435 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.725521 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.725743 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.725828 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.726050 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.726138 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.726358 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.726446 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.726667 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.726831 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.726981 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.727064 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.727275 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.727390 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.727609 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.727697 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.727921 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.728076 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.728233 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.728365 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.728542 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.728698 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.728853 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.728949 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.729182 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.729376 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.729504 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.729691 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.729817 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.730024 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.730134 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.730353 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.730441 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.730678 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.730962 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.731058 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.731277 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.731416 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.731653 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.731742 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.731964 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.732052 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.732270 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.732357 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.732581 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.732676 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.732892 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.732987 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.733197 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.733284 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.733504 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.733598 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.733808 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.733903 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.734110 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.734250 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.734415 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.734502 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.734718 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.734807 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.735039 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.735249 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.735345 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.736244 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.736366 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.736476 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.736565 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.736765 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.736862 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.737090 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.737300 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.737395 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.737651 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.737739 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.737972 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.738071 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.738300 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.738385 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.738605 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.738692 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.738919 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.739017 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.739225 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.739310 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.739552 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.739640 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.739856 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.739952 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.740165 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.740252 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.740472 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.740558 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.740779 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.740868 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.741083 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.741185 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.741382 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.741472 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.741691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.741786 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.741995 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.742087 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.742297 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.742392 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.742598 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.742683 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.742899 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.742993 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.743200 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.743295 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.743538 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.743628 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.743844 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.743932 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.744143 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.744239 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.744451 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.744539 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.744753 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.744845 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.745056 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.745152 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.745355 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.745447 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.745655 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.745740 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.745967 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.746055 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.746270 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.746355 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.746577 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.746663 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.746880 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.746984 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.747188 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.747326 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.747515 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.747611 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.747833 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.747959 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.748144 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.748231 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.748467 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.748552 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.748776 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.748862 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.749078 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.749171 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.749395 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.749489 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.749706 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.749794 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.750027 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.750238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.750326 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.750571 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.750669 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.750890 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.751028 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.751833 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.751930 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.752167 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.752367 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.752483 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.752699 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.752787 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.753020 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.753120 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.753350 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.753438 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.753679 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.753768 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.753987 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.754076 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.754291 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.754390 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.754597 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.754682 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.754907 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.755002 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.755217 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.755305 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.755551 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.755641 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.755861 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.755948 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.756167 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.756260 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.756475 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.756563 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.756784 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.756872 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.757091 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.757187 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.757398 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.757493 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.757704 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.757790 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.758010 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.758095 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.758319 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.758414 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.758628 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.758764 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.758936 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.759024 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.759243 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.759406 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.759582 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.759672 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.759893 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.759980 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.760202 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.760291 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.760511 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.760643 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.760819 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.760914 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.761133 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.761220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.761443 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.761529 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.761753 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.761839 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.762058 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.762145 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.762365 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.762681 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.762767 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.763289 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.763420 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.763625 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.763712 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.763933 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.764033 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.764275 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.764593 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.764681 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.764912 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.764998 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.765225 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.765319 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.765544 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.765631 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.765855 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.765945 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.766177 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.766264 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.766500 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.766586 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.766853 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.766986 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.767174 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.767262 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.767503 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.767594 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.767813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.767899 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.768120 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.768209 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.768430 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.768517 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.768748 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.768843 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.769060 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.769155 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.769362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.769463 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.769665 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.769759 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.769977 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.770093 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.770278 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.770366 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.770583 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.770697 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.770886 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.770980 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.771185 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.771284 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.771522 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.771634 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.771826 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.771925 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.772128 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.772211 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.772433 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.772517 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.772734 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.772819 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.773035 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.773120 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.773337 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.773422 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.773643 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.773727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.773945 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.774029 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.774243 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.774334 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.774544 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.774634 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.774842 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.774933 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.775140 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.775231 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.775463 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.775551 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.775767 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.775868 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.776069 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.776154 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.776369 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.776462 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.776668 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.776802 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.777000 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.777164 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.777315 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.777451 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.777618 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.777767 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.777936 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.778073 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.778246 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.778387 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.778555 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.778698 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.778859 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.778998 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.779178 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.779317 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.779521 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.779659 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.779793 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.779936 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.780099 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.780191 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.780391 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.780482 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.780698 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.780843 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.781010 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.781096 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.781396 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.781497 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.781622 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.781708 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.781927 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.782022 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.782732 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.782830 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.783065 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.783151 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.783387 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.783489 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.783699 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.783787 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.784023 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.784109 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.784334 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.784428 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.784645 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.784733 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.784957 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.785044 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.785266 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.785352 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.785575 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.785662 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.785890 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.785976 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.786198 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.786291 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.786504 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.786589 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.786813 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.786904 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.787124 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.787212 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.787461 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.787552 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.787774 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.787873 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.788082 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.788167 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.788396 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.788482 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.788711 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.788812 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.789037 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.789124 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.789351 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.789438 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.789660 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.789755 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.789985 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.790073 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.790305 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.790400 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.790615 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.790712 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.790920 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.791007 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.791162 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110775) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 00:11:07.791273 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.791628 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.791939 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.792258 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.792563 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:11:07.792806 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 00:11:07.943782 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO dbcounter [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Registered counter for database nova_api Oct 12 00:11:07.944751 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO dbcounter [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Registered counter for database nova_api Oct 12 00:11:07.964014 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:11:07.967536 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_db.sqlalchemy.engines [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:11:07.971067 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writer thread running {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:11:07.974641 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writer thread running {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:11:08.027734 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.context [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b25f271-a621-44c9-82e0-2017e2b25b27(cell1) {{(pid=110775) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 00:11:08.030789 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.context [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b25f271-a621-44c9-82e0-2017e2b25b27(cell1) {{(pid=110774) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 00:11:08.031573 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:11:08.032047 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:11:08.034129 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:11:08.034850 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:11:08.035161 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_concurrency.lockutils [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:11:08.035297 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:11:08.035666 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_concurrency.lockutils [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:11:08.037220 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_concurrency.lockutils [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:11:08.037330 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:11:08.037946 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_concurrency.lockutils [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:11:08.038388 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_concurrency.lockutils [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:11:08.039269 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO dbcounter [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Registered counter for database nova_cell0 Oct 12 00:11:08.040400 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_concurrency.lockutils [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:11:08.042393 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO dbcounter [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Registered counter for database nova_cell0 Oct 12 00:11:08.043263 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO dbcounter [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Registered counter for database nova_cell1 Oct 12 00:11:08.046337 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO dbcounter [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Registered counter for database nova_cell1 Oct 12 00:11:08.051214 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:11:08.053550 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:11:08.054956 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_db.sqlalchemy.engines [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:11:08.056839 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writer thread running {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:11:08.057175 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_db.sqlalchemy.engines [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:11:08.062648 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writer thread running {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:11:08.064927 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writer thread running {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:11:08.197310 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writer thread running {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:11:08.206365 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO dbcounter [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Registered counter for database nova_cell0 Oct 12 00:11:08.209623 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO dbcounter [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Registered counter for database nova_cell0 Oct 12 00:11:08.215277 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_db.sqlalchemy.engines [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110775) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:11:08.218852 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG oslo_db.sqlalchemy.engines [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:11:08.220593 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writer thread running {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:11:08.224398 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writer thread running {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:11:08.625642 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: WARNING keystonemiddleware.auth_token [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 00:11:08.633409 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: WARNING keystonemiddleware.auth_token [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 00:11:08.635986 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: WARNING keystonemiddleware.auth_token [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 00:11:08.643987 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: WARNING keystonemiddleware.auth_token [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 00:11:08.974064 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: WARNING keystonemiddleware.auth_token [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 00:11:08.980034 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: WARNING keystonemiddleware.auth_token [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 00:11:08.983150 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: WARNING keystonemiddleware.auth_token [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 00:11:08.985823 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559da58499c0 pid: 110775 (default app) Oct 12 00:11:08.987945 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:11:08.989110 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001743 Oct 12 00:11:08.989527 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Wed Oct 12 00:11:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:11:08.989685 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: WARNING keystonemiddleware.auth_token [None req-58234d21-f909-46f2-97ac-2ad852477c0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 00:11:08.995098 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559da58499c0 pid: 110774 (default app) Oct 12 00:12:32.028854 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:32.029759 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 12 00:12:32.030670 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:32.042405 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writing DB stats nova_api:SELECT=3 {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:12:32.043576 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writing DB stats nova_cell0:SELECT=3 {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:12:32.044276 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writing DB stats nova_cell1:SELECT=3 {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:12:32.047349 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:12:32.919318 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-6564bc0e-9c45-4f25-b5b1-7ec609949d1d admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:32.953930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-6564bc0e-9c45-4f25-b5b1-7ec609949d1d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.916608 Oct 12 00:12:32.954667 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Oct 12 00:12:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:12:35.565637 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:35.566642 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-3e4d65cc-1fc9-4561-9ba9-35bd654c73c6 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Oct 12 00:12:35.567602 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:36.002769 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-72201a1e-fe1b-4662-970a-6d0e896a8dca admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:36.111206 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-72201a1e-fe1b-4662-970a-6d0e896a8dca admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.537922 Oct 12 00:12:36.111855 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:12:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:12:36.126221 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_api:SELECT=3 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:12:36.127020 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_cell0:SELECT=3 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:12:36.129003 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_cell1:SELECT=3 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:12:36.130022 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:12:36.333355 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-d1f8eee7-fd99-45a1-b558-7227b4a82e17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:36.457379 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-d1f8eee7-fd99-45a1-b558-7227b4a82e17 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.336938 Oct 12 00:12:36.458159 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Oct 12 00:12:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:12:39.052335 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-72201a1e-fe1b-4662-970a-6d0e896a8dca admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:39.053274 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-72201a1e-fe1b-4662-970a-6d0e896a8dca admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 12 00:12:39.053674 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:39.704877 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-cbf8e756-e034-42c8-b5f7-652353306b51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:39.822866 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-cbf8e756-e034-42c8-b5f7-652353306b51 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763018 Oct 12 00:12:39.823700 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:12:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:12:39.836897 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-c367d7c8-a99a-4f41-b45d-902647db4986 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:39.963116 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-c367d7c8-a99a-4f41-b45d-902647db4986 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130015 Oct 12 00:12:39.963839 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Oct 12 00:12:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:12:42.516490 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-cbf8e756-e034-42c8-b5f7-652353306b51 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:42.517495 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-cbf8e756-e034-42c8-b5f7-652353306b51 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 12 00:12:42.517894 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:42.931528 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-71182350-7607-442b-968e-bc4d79471963 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "id": "d2", "swap": 0, "disk": 10, "name": "ds1G"}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:42.998117 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-71182350-7607-442b-968e-bc4d79471963 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474272 Oct 12 00:12:42.999193 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:12:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 00:12:43.011339 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-7bae5ef3-325e-4668-8dac-5b3f33557d83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:43.089127 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-7bae5ef3-325e-4668-8dac-5b3f33557d83 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081449 Oct 12 00:12:43.089727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Oct 12 00:12:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:12:45.677254 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-71182350-7607-442b-968e-bc4d79471963 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:45.678265 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-71182350-7607-442b-968e-bc4d79471963 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 12 00:12:45.678665 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:46.107244 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a56fd890-230f-4ea9-9967-32b5fb844067 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "swap": 0}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:46.194467 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-a56fd890-230f-4ea9-9967-32b5fb844067 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509637 Oct 12 00:12:46.195768 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:12:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:12:46.208356 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-f411789a-0480-4c1a-acee-9b13cfebb6c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:46.317603 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-f411789a-0480-4c1a-acee-9b13cfebb6c9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113001 Oct 12 00:12:46.318802 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Oct 12 00:12:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:12:48.971464 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a56fd890-230f-4ea9-9967-32b5fb844067 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:48.973201 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-a56fd890-230f-4ea9-9967-32b5fb844067 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 Oct 12 00:12:48.973737 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:49.378076 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-264ccfc7-267b-4c1d-8555-ec0e892fb7cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "disk": 20}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:49.455720 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-264ccfc7-267b-4c1d-8555-ec0e892fb7cb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474259 Oct 12 00:12:49.456258 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:12:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 00:12:49.468627 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-48723416-30fc-46e5-9ee7-e2a3c4c9ee51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:49.539093 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-48723416-30fc-46e5-9ee7-e2a3c4c9ee51 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074004 Oct 12 00:12:49.539646 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1336 bytes} [Wed Oct 12 00:12:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:12:52.190775 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-264ccfc7-267b-4c1d-8555-ec0e892fb7cb admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:52.192143 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-264ccfc7-267b-4c1d-8555-ec0e892fb7cb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001872 Oct 12 00:12:52.192691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:52.627812 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-4e449ed3-27df-43c7-92f0-a1200238ce02 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:52.660037 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-4e449ed3-27df-43c7-92f0-a1200238ce02 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460937 Oct 12 00:12:52.660656 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Oct 12 00:12:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:12:55.306067 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-264ccfc7-267b-4c1d-8555-ec0e892fb7cb admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:55.307079 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-264ccfc7-267b-4c1d-8555-ec0e892fb7cb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 12 00:12:55.307668 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:55.696286 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-b1b53add-50b1-44c5-ba0c-601304412282 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "swap": 0, "disk": 1}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:55.754875 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-b1b53add-50b1-44c5-ba0c-601304412282 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.441429 Oct 12 00:12:55.755564 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:12:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 00:12:55.768439 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-1d7c105a-5037-4551-a41a-8d308ef8bf5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:55.847767 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-1d7c105a-5037-4551-a41a-8d308ef8bf5d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083604 Oct 12 00:12:55.848286 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Oct 12 00:12:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:12:58.437712 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-b1b53add-50b1-44c5-ba0c-601304412282 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:12:58.437712 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-b1b53add-50b1-44c5-ba0c-601304412282 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 12 00:12:58.437712 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:12:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:12:58.839982 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-10a15565-dffc-4bdc-8102-1d966f45534c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:58.917223 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-10a15565-dffc-4bdc-8102-1d966f45534c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.480509 Oct 12 00:12:58.917771 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:12:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:12:58.930659 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-b246005f-656c-4c07-bcda-39d15045d6d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:12:59.024526 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-b246005f-656c-4c07-bcda-39d15045d6d7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097558 Oct 12 00:12:59.025100 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Oct 12 00:12:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:13:01.632957 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-10a15565-dffc-4bdc-8102-1d966f45534c admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:01.633979 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-10a15565-dffc-4bdc-8102-1d966f45534c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 12 00:13:01.634380 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:13:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:02.096763 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-bcf496b8-e35d-4fa8-8ba3-f292b8f4e4af admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:02.170602 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-bcf496b8-e35d-4fa8-8ba3-f292b8f4e4af admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.528888 Oct 12 00:13:02.183316 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-6f66bb0e-7e8f-4449-8aed-a57ceea028d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:02.189256 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:13:02.189540 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:13:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:13:02.299585 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-6f66bb0e-7e8f-4449-8aed-a57ceea028d2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119886 Oct 12 00:13:02.300210 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Oct 12 00:13:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:13:04.937562 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-bcf496b8-e35d-4fa8-8ba3-f292b8f4e4af admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:04.938606 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-bcf496b8-e35d-4fa8-8ba3-f292b8f4e4af admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Oct 12 00:13:04.939270 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:13:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:05.377448 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-f24f0274-a738-49e6-b736-45656a0749bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:05.443870 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-f24f0274-a738-49e6-b736-45656a0749bc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.498351 Oct 12 00:13:05.444702 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:13:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:13:05.457520 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-cf0e1650-6b9a-495d-a174-7438fc32c22f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:05.547928 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-cf0e1650-6b9a-495d-a174-7438fc32c22f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094079 Oct 12 00:13:05.548592 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Oct 12 00:13:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:13:08.192068 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-f24f0274-a738-49e6-b736-45656a0749bc admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:08.193247 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-f24f0274-a738-49e6-b736-45656a0749bc admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 12 00:13:08.195856 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:13:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:08.631189 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a056acf7-6140-4300-9980-a271ad0d6e08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:08.697212 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-a056acf7-6140-4300-9980-a271ad0d6e08 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.497231 Oct 12 00:13:08.699412 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1283 bytes} [Wed Oct 12 00:13:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:13:08.710682 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-ae3a8f9e-2e8f-46a8-8d74-1b7107a9dd39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:08.779136 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-ae3a8f9e-2e8f-46a8-8d74-1b7107a9dd39 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.071976 Oct 12 00:13:08.779848 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1333 bytes} [Wed Oct 12 00:13:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:13:26.016964 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a056acf7-6140-4300-9980-a271ad0d6e08 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:26.017967 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-a056acf7-6140-4300-9980-a271ad0d6e08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Oct 12 00:13:26.018361 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:13:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:26.028662 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:13:26.403348 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-388dc79a-2027-4fed-a333-09e07a1d2a77 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:26.421751 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-388dc79a-2027-4fed-a333-09e07a1d2a77 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397502 Oct 12 00:13:26.422284 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Oct 12 00:13:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:13:27.710793 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a056acf7-6140-4300-9980-a271ad0d6e08 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:27.711831 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-a056acf7-6140-4300-9980-a271ad0d6e08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Oct 12 00:13:27.712226 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:28.224569 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-e6d9b9e3-5a53-4580-823d-50b12c2ee438 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:28.229872 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.wsgi [None req-e6d9b9e3-5a53-4580-823d-50b12c2ee438 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-e6d9b9e3-5a53-4580-823d-50b12c2ee438 admin admin] Request method failure captured: Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Accept: application/json Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Accept-Encoding: gzip, deflate Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Connection: keep-alive Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Content-Length: 0 Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Host: 10.222.0.36 Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Openstack-Api-Version: compute 2.92 Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Openstack-System-Scope: None Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: User-Agent: python-novaclient Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Auth-Token: gAAAAABjRgan_QktMkc2i6SHDIa_U5oU_Cj7eOi7etMII0Yr8EBo4lR6uooh6jsCZ1ar9rBZHG-QBah3AF3-7nAmqJn6TXQwOc9AXUuEGNH1sXRTIc69LqDcKNgo0YG33QmiG44XtK13_0SUxtuXl_2hihSwSZe23OMWf1GVeBwmmIctVuXKVbc Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Domain-Id: None Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Domain-Name: None Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Identity-Status: Confirmed Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Is-Admin-Project: True Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Domain-Id: default Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Domain-Name: Default Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Name: admin Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Role: member,admin,reader Oct 12 00:13:28.233829 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Roles: member,admin,reader Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_392dba9b727b479aa54a2746402ded73", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/392dba9b727b479aa54a2746402ded73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant: admin Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant-Name: admin Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User: admin Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Domain-Id: default Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Domain-Name: Default Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Id: 1fcb9022bfe743ae9405fc8470a5e016 Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Name: admin Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: method: > Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: exception: Flavor 42 could not be found. Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: action_args: {'id': '42'} Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:13:28.235555 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:28.236554 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.237873 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-e6d9b9e3-5a53-4580-823d-50b12c2ee438 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:13:28.239093 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-e6d9b9e3-5a53-4580-823d-50b12c2ee438 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.386662 Oct 12 00:13:28.239093 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Oct 12 00:13:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 00:13:28.245184 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-e3017cb4-db82-4676-9b15-c6aa78521cb4 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:28.249353 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:13:28.268309 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-e3017cb4-db82-4676-9b15-c6aa78521cb4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026649 Oct 12 00:13:28.268873 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Oct 12 00:13:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:13:28.280022 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-503d8c5f-a726-4238-84c5-79f5946b2439 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:28.302134 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-503d8c5f-a726-4238-84c5-79f5946b2439 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027099 Oct 12 00:13:28.302687 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Oct 12 00:13:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:13:28.312453 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-0d48df91-8793-47ab-92f6-5dbc1fc80686 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:28.318904 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.wsgi [None req-0d48df91-8793-47ab-92f6-5dbc1fc80686 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-0d48df91-8793-47ab-92f6-5dbc1fc80686 admin admin] Request method failure captured: Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Accept: application/json Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Accept-Encoding: gzip, deflate Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Connection: keep-alive Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Content-Length: 0 Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Host: 10.222.0.36 Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Openstack-Api-Version: compute 2.92 Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Openstack-System-Scope: None Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: User-Agent: python-novaclient Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Auth-Token: gAAAAABjRgan_QktMkc2i6SHDIa_U5oU_Cj7eOi7etMII0Yr8EBo4lR6uooh6jsCZ1ar9rBZHG-QBah3AF3-7nAmqJn6TXQwOc9AXUuEGNH1sXRTIc69LqDcKNgo0YG33QmiG44XtK13_0SUxtuXl_2hihSwSZe23OMWf1GVeBwmmIctVuXKVbc Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Domain-Id: None Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Domain-Name: None Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Identity-Status: Confirmed Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Is-Admin-Project: True Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Domain-Id: default Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Domain-Name: Default Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Name: admin Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Role: member,admin,reader Oct 12 00:13:28.321507 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Roles: member,admin,reader Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_392dba9b727b479aa54a2746402ded73", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/392dba9b727b479aa54a2746402ded73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant: admin Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant-Name: admin Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User: admin Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Domain-Id: default Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Domain-Name: Default Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Id: 1fcb9022bfe743ae9405fc8470a5e016 Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Name: admin Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: method: > Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: exception: Flavor 42 could not be found. Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: action_args: {'id': '42'} Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:13:28.322813 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:28.323612 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:28.324640 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-0d48df91-8793-47ab-92f6-5dbc1fc80686 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:13:28.325705 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-0d48df91-8793-47ab-92f6-5dbc1fc80686 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014505 Oct 12 00:13:28.325705 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Oct 12 00:13:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 00:13:29.523171 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-503d8c5f-a726-4238-84c5-79f5946b2439 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:29.524219 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-503d8c5f-a726-4238-84c5-79f5946b2439 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Oct 12 00:13:29.524618 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:13:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:30.043756 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-963bb415-47ae-4d4a-9c9e-e7f45c66dfc4 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:30.048726 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.wsgi [None req-963bb415-47ae-4d4a-9c9e-e7f45c66dfc4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-963bb415-47ae-4d4a-9c9e-e7f45c66dfc4 admin admin] Request method failure captured: Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Accept: application/json Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Accept-Encoding: gzip, deflate Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Connection: keep-alive Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Content-Length: 0 Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Host: 10.222.0.36 Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Openstack-Api-Version: compute 2.92 Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Openstack-System-Scope: None Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: User-Agent: python-novaclient Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Auth-Token: gAAAAABjRgapKFhURr_jdTuP7yyotysUpr4krqjCPaQVmuId_cPpsPEiiEbCL0IAtXCek1tSCo-pfLSiM86d-vGb7IAzWUAB2hOzeMnOoMK7orRuo4n8QpMnNGkYZ1WToDG4hsQlm8d7jUIKJj5A8iQumBCV2Q2kXw-ek5Dt8tp-HXycBOFNbJk Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Domain-Id: None Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Domain-Name: None Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Identity-Status: Confirmed Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Is-Admin-Project: True Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Domain-Id: default Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Domain-Name: Default Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Name: admin Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Role: member,admin,reader Oct 12 00:13:30.050220 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Roles: member,admin,reader Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_392dba9b727b479aa54a2746402ded73", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/392dba9b727b479aa54a2746402ded73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant: admin Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant-Name: admin Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User: admin Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Domain-Id: default Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Domain-Name: Default Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Id: 1fcb9022bfe743ae9405fc8470a5e016 Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Name: admin Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: method: > Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: exception: Flavor 84 could not be found. Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: action_args: {'id': '84'} Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:13:30.051727 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:30.052599 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.053809 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-963bb415-47ae-4d4a-9c9e-e7f45c66dfc4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:13:30.055029 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-963bb415-47ae-4d4a-9c9e-e7f45c66dfc4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391147 Oct 12 00:13:30.055029 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Oct 12 00:13:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 00:13:30.061353 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-d57011f6-6ecd-49b4-bed9-d0453d10760f admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:30.076429 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-d57011f6-6ecd-49b4-bed9-d0453d10760f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018686 Oct 12 00:13:30.076952 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Oct 12 00:13:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:13:30.086432 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-d91eb7ec-6664-4874-8002-37810cd6d0ca admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:30.102042 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-d91eb7ec-6664-4874-8002-37810cd6d0ca admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019548 Oct 12 00:13:30.102552 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Oct 12 00:13:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:13:30.111696 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-514d88ec-ee5e-40e7-b76f-37b75371e9a6 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:30.116561 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.wsgi [None req-514d88ec-ee5e-40e7-b76f-37b75371e9a6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-514d88ec-ee5e-40e7-b76f-37b75371e9a6 admin admin] Request method failure captured: Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Accept: application/json Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Accept-Encoding: gzip, deflate Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Connection: keep-alive Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Content-Length: 0 Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Host: 10.222.0.36 Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Openstack-Api-Version: compute 2.92 Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Openstack-System-Scope: None Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: User-Agent: python-novaclient Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Auth-Token: gAAAAABjRgapKFhURr_jdTuP7yyotysUpr4krqjCPaQVmuId_cPpsPEiiEbCL0IAtXCek1tSCo-pfLSiM86d-vGb7IAzWUAB2hOzeMnOoMK7orRuo4n8QpMnNGkYZ1WToDG4hsQlm8d7jUIKJj5A8iQumBCV2Q2kXw-ek5Dt8tp-HXycBOFNbJk Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Domain-Id: None Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Domain-Name: None Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Identity-Status: Confirmed Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Is-Admin-Project: True Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Domain-Id: default Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Domain-Name: Default Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Name: admin Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Role: member,admin,reader Oct 12 00:13:30.118043 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Roles: member,admin,reader Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_392dba9b727b479aa54a2746402ded73", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/392dba9b727b479aa54a2746402ded73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant: admin Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant-Name: admin Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User: admin Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Domain-Id: default Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Domain-Name: Default Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Id: 1fcb9022bfe743ae9405fc8470a5e016 Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Name: admin Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: method: > Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: exception: Flavor 84 could not be found. Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: action_args: {'id': '84'} Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:13:30.119547 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:30.120362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:30.121622 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-514d88ec-ee5e-40e7-b76f-37b75371e9a6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:13:30.122847 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-514d88ec-ee5e-40e7-b76f-37b75371e9a6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011116 Oct 12 00:13:30.122847 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Wed Oct 12 00:13:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 12 00:13:31.323895 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-d91eb7ec-6664-4874-8002-37810cd6d0ca admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:31.324947 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-d91eb7ec-6664-4874-8002-37810cd6d0ca admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 12 00:13:31.325345 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:31.845545 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-2ae5ec15-60eb-4229-9802-514d5fa496aa admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:31.851435 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.wsgi [None req-2ae5ec15-60eb-4229-9802-514d5fa496aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-2ae5ec15-60eb-4229-9802-514d5fa496aa admin admin] Request method failure captured: Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Accept: application/json Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Accept-Encoding: gzip, deflate Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Connection: keep-alive Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Content-Length: 0 Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Host: 10.222.0.36 Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Openstack-Api-Version: compute 2.92 Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Openstack-System-Scope: None Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: User-Agent: python-novaclient Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Auth-Token: gAAAAABjRgarW--T_tDRQ9R9jOHHwjgIKDfcM7hXMqVnP1WNI1jyUmZbatR8E4asEnwsB_sF0wmJLabHkg9b5oylNuv0yL3KsR2YGWunOfzmeiP4TQmnJMFzovjgA1K4LA67tkeOwxKO1RvjH4sivLsngBX2IEyFvOF0eb58Z-4KoGwwMCAwLmE Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Domain-Id: None Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Domain-Name: None Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Identity-Status: Confirmed Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Is-Admin-Project: True Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Domain-Id: default Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Domain-Name: Default Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Project-Name: admin Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Role: member,admin,reader Oct 12 00:13:31.852930 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Roles: member,admin,reader Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_392dba9b727b479aa54a2746402ded73", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/392dba9b727b479aa54a2746402ded73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant: admin Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-Tenant-Name: admin Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User: admin Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Domain-Id: default Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Domain-Name: Default Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Id: 1fcb9022bfe743ae9405fc8470a5e016 Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: X-User-Name: admin Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: method: > Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: exception: Flavor 451 could not be found. Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: action_args: {'id': '451'} Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:13:31.854502 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:31.855518 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.856691 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-2ae5ec15-60eb-4229-9802-514d5fa496aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:13:31.857669 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-2ae5ec15-60eb-4229-9802-514d5fa496aa admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391104 Oct 12 00:13:31.857669 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Oct 12 00:13:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 00:13:31.864080 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-4be2499c-62be-4160-8ca6-b5dbaf6ddeef admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:31.879193 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-4be2499c-62be-4160-8ca6-b5dbaf6ddeef admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018664 Oct 12 00:13:31.879751 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Oct 12 00:13:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:13:31.889558 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:31.904693 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019235 Oct 12 00:13:31.905216 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Wed Oct 12 00:13:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:13:31.914257 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a84f2150-554c-4b7b-8e93-9c3d4b159540 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:31.919143 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.wsgi [None req-a84f2150-554c-4b7b-8e93-9c3d4b159540 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a84f2150-554c-4b7b-8e93-9c3d4b159540 admin admin] Request method failure captured: Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Accept: application/json Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Accept-Encoding: gzip, deflate Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Connection: keep-alive Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Content-Length: 0 Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Host: 10.222.0.36 Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Openstack-Api-Version: compute 2.92 Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Openstack-System-Scope: None Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: User-Agent: python-novaclient Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Auth-Token: gAAAAABjRgarW--T_tDRQ9R9jOHHwjgIKDfcM7hXMqVnP1WNI1jyUmZbatR8E4asEnwsB_sF0wmJLabHkg9b5oylNuv0yL3KsR2YGWunOfzmeiP4TQmnJMFzovjgA1K4LA67tkeOwxKO1RvjH4sivLsngBX2IEyFvOF0eb58Z-4KoGwwMCAwLmE Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Domain-Id: None Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Domain-Name: None Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Identity-Status: Confirmed Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Is-Admin-Project: True Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Domain-Id: default Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Domain-Name: Default Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Project-Name: admin Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Role: member,admin,reader Oct 12 00:13:31.920673 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Roles: member,admin,reader Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_392dba9b727b479aa54a2746402ded73", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/392dba9b727b479aa54a2746402ded73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/392dba9b727b479aa54a2746402ded73"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant: admin Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant-Id: 392dba9b727b479aa54a2746402ded73 Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-Tenant-Name: admin Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User: admin Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Domain-Id: default Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Domain-Name: Default Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Id: 1fcb9022bfe743ae9405fc8470a5e016 Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: X-User-Name: admin Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: method: > Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: exception: Flavor 451 could not be found. Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: action_args: {'id': '451'} Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:13:31.922210 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:31.923238 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: ERROR nova.api.openstack.wsgi Oct 12 00:13:31.924308 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a84f2150-554c-4b7b-8e93-9c3d4b159540 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:13:31.925284 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-a84f2150-554c-4b7b-8e93-9c3d4b159540 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011250 Oct 12 00:13:31.925284 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Oct 12 00:13:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 00:13:33.143639 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:33.144651 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 12 00:13:33.145038 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:33.661312 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-b4cdc893-c5ae-40cd-91fa-54e1a0f933ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:33.716892 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-b4cdc893-c5ae-40cd-91fa-54e1a0f933ff admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.434017 Oct 12 00:13:33.717367 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Oct 12 00:13:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:13:34.920319 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:34.921331 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 12 00:13:34.924149 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:13:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:35.436529 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-4e1c5887-5885-46d8-9b73-04367a7f9cef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:35.493946 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-4e1c5887-5885-46d8-9b73-04367a7f9cef admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.436997 Oct 12 00:13:35.494476 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Oct 12 00:13:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:13:36.693138 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:36.694137 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Oct 12 00:13:36.694521 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:37.205515 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-190af0eb-54f2-448f-a55b-61c6f7a08a7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:37.294905 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-190af0eb-54f2-448f-a55b-61c6f7a08a7c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.464818 Oct 12 00:13:37.295465 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Oct 12 00:13:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:13:38.505586 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:38.506633 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 12 00:13:38.507029 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:13:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:39.021591 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-5beac937-59f2-41f8-9d6c-2520202abf14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:13:39.093995 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-5beac937-59f2-41f8-9d6c-2520202abf14 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.451027 Oct 12 00:13:39.094695 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Wed Oct 12 00:13:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:13:40.297228 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:40.298271 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 12 00:13:40.298663 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:13:40.812582 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-76aebf3d-2d98-40a5-981e-314295b94068 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:13:40.832930 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-76aebf3d-2d98-40a5-981e-314295b94068 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398383 Oct 12 00:13:40.833459 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Wed Oct 12 00:13:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:14:36.996727 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:14:36.997744 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-476f0c8c-d278-45f0-8e9b-df009c7055f2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 12 00:14:36.998143 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 931 bytes} [Wed Oct 12 00:14:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:14:37.008479 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:14:37.384290 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-41b01932-2763-4f5d-917b-7597fa19fbb9 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:14:37.404684 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-41b01932-2763-4f5d-917b-7597fa19fbb9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400664 Oct 12 00:14:37.405208 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1292 bytes} [Wed Oct 12 00:14:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:14:37.426570 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writing DB stats nova_api:SELECT=14 {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:14:37.430199 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-a77928fd-ed83-46ae-9368-3696de4971ac admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:14:37.437885 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-a77928fd-ed83-46ae-9368-3696de4971ac admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012767 Oct 12 00:14:37.438393 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1283 bytes} [Wed Oct 12 00:14:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:14:37.449597 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-47760e39-4f7c-4f52-9561-a5f7a5526a46 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:14:37.456708 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-47760e39-4f7c-4f52-9561-a5f7a5526a46 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010649 Oct 12 00:14:37.457206 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1286 bytes} [Wed Oct 12 00:14:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:14:37.468433 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:14:37.475419 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010672 Oct 12 00:14:37.475925 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1286 bytes} [Wed Oct 12 00:14:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:14:37.487069 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-a9603c3a-668e-4865-81d0-6cdcd64c561e admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:14:37.494113 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-a9603c3a-668e-4865-81d0-6cdcd64c561e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010289 Oct 12 00:14:37.494627 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1283 bytes} [Wed Oct 12 00:14:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:17:58.678911 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:17:58.679963 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 12 00:17:58.680361 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:17:58.818722 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_api:SELECT=6 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:17:58.959095 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-05d2a7a0-b60d-44be-83ef-ef61eb89a99b admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:17:58.963764 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-05d2a7a0-b60d-44be-83ef-ef61eb89a99b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:17:58.968275 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-05d2a7a0-b60d-44be-83ef-ef61eb89a99b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:17:58.968275 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-05d2a7a0-b60d-44be-83ef-ef61eb89a99b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:17:58.968275 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-05d2a7a0-b60d-44be-83ef-ef61eb89a99b admin admin] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:17:58.968275 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-05d2a7a0-b60d-44be-83ef-ef61eb89a99b admin admin] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:17:58.968731 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-05d2a7a0-b60d-44be-83ef-ef61eb89a99b admin admin] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:17:58.997450 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-05d2a7a0-b60d-44be-83ef-ef61eb89a99b admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.179819 Oct 12 00:17:58.998033 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Oct 12 00:17:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 00:18:00.069192 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:18:00.070193 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 12 00:18:00.070589 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:18:00.260188 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-de913dae-9eba-4b7b-9858-9137c0ff9144 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:18:00.263614 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-de913dae-9eba-4b7b-9858-9137c0ff9144 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:18:00.264235 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-de913dae-9eba-4b7b-9858-9137c0ff9144 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:18:00.264667 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-de913dae-9eba-4b7b-9858-9137c0ff9144 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:18:00.265654 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-de913dae-9eba-4b7b-9858-9137c0ff9144 admin admin] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:18:00.266096 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-de913dae-9eba-4b7b-9858-9137c0ff9144 admin admin] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:18:00.266504 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-de913dae-9eba-4b7b-9858-9137c0ff9144 admin admin] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:18:00.286458 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-de913dae-9eba-4b7b-9858-9137c0ff9144 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.077407 Oct 12 00:18:00.286946 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Oct 12 00:18:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:18:11.777326 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:18:11.778362 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 12 00:18:11.778750 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:18:11.922169 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_cell0:SELECT=4 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:18:11.922896 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_cell1:SELECT=4 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:18:11.923535 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG dbcounter [-] [110775] Writing DB stats nova_api:SELECT=8 {{(pid=110775) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:18:11.970680 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-871de5be-226c-47d8-88b4-8e7511f40bbf admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:18:11.974633 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-871de5be-226c-47d8-88b4-8e7511f40bbf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:18:11.975099 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-871de5be-226c-47d8-88b4-8e7511f40bbf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:18:11.975575 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-871de5be-226c-47d8-88b4-8e7511f40bbf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:18:11.976275 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-871de5be-226c-47d8-88b4-8e7511f40bbf admin admin] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:18:11.976740 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-871de5be-226c-47d8-88b4-8e7511f40bbf admin admin] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:18:11.977131 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-871de5be-226c-47d8-88b4-8e7511f40bbf admin admin] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:18:12.002242 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-871de5be-226c-47d8-88b4-8e7511f40bbf admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.084370 Oct 12 00:18:12.002719 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Oct 12 00:18:11 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:18:13.068235 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG nova.api.openstack.wsgi [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] Calling method '>' {{(pid=110774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:18:13.069234 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: INFO nova.api.openstack.requestlog [None req-b662e17a-34b3-43e0-a9fe-fc3043adc346 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Oct 12 00:18:13.069643 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: [pid: 110774|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Wed Oct 12 00:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:18:13.256823 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG nova.api.openstack.wsgi [None req-0873093a-116c-4392-8842-5ffb0e25ad62 admin admin] Calling method '>' {{(pid=110775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:18:13.260248 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-0873093a-116c-4392-8842-5ffb0e25ad62 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:18:13.260715 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-0873093a-116c-4392-8842-5ffb0e25ad62 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:18:13.261131 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-0873093a-116c-4392-8842-5ffb0e25ad62 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:18:13.261833 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-0873093a-116c-4392-8842-5ffb0e25ad62 admin admin] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:18:13.262269 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-0873093a-116c-4392-8842-5ffb0e25ad62 admin admin] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:18:13.262679 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: DEBUG oslo_concurrency.lockutils [None req-0873093a-116c-4392-8842-5ffb0e25ad62 admin admin] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110775) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:18:13.284594 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: INFO nova.api.openstack.requestlog [None req-0873093a-116c-4392-8842-5ffb0e25ad62 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078909 Oct 12 00:18:13.285737 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: [pid: 110775|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Wed Oct 12 00:18:13 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:19:10.101430 dv-cinder-849143-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 12 00:19:10.102432 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: Wed Oct 12 00:19:10 2022 - graceful shutdown triggered... Oct 12 00:19:10.102872 dv-cinder-849143-13-iscsi devstack@n-api.service[110775]: Gracefully killing worker 2 (pid: 110775)... Oct 12 00:19:10.103238 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: Gracefully killing worker 1 (pid: 110774)... Oct 12 00:19:10.227476 dv-cinder-849143-13-iscsi devstack@n-api.service[110774]: DEBUG dbcounter [-] [110774] Writing DB stats nova_api:SELECT=4 {{(pid=110774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:11.108523 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: worker 1 buried after 1 seconds Oct 12 00:19:11.108959 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: worker 2 buried after 1 seconds Oct 12 00:19:11.108959 dv-cinder-849143-13-iscsi devstack@n-api.service[110773]: goodbye to uWSGI. Oct 12 00:19:11.110095 dv-cinder-849143-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 12 00:19:11.110657 dv-cinder-849143-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 12 00:19:11.114101 dv-cinder-849143-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 00:19:11.123136 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 00:19:11 2022] *** Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: nodename: dv-cinder-849143-13-iscsi Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: machine: x86_64 Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: clock source: unix Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: pcre jit disabled Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: detected number of CPU cores: 4 Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: current working directory: / Oct 12 00:19:11.126709 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: detected binary path: /usr/bin/uwsgi-core Oct 12 00:19:11.127523 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: your processes number limit is 47680 Oct 12 00:19:11.127523 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: your memory page size is 4096 bytes Oct 12 00:19:11.127523 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: detected max file descriptor number: 2048 Oct 12 00:19:11.127523 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: lock engine: pthread robust mutexes Oct 12 00:19:11.127523 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: thunder lock: enabled Oct 12 00:19:11.127523 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 00:19:11.127523 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 00:19:11.169368 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: Python main interpreter initialized at 0x5618881289c0 Oct 12 00:19:11.169368 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: python threads support enabled Oct 12 00:19:11.169368 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: your server socket listen backlog is limited to 100 connections Oct 12 00:19:11.169368 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: your mercy for graceful operations on workers is 90 seconds Oct 12 00:19:11.169821 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 00:19:11.169821 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: *** Operational MODE: preforking *** Oct 12 00:19:11.170086 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: *** uWSGI is running in multiple interpreter mode *** Oct 12 00:19:11.170086 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: spawned uWSGI master process (pid: 125788) Oct 12 00:19:11.170294 dv-cinder-849143-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 12 00:19:11.173026 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: spawned uWSGI worker 1 (pid: 125809, cores: 1) Oct 12 00:19:11.173026 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: spawned uWSGI worker 2 (pid: 125810, cores: 1) Oct 12 00:19:11.173026 dv-cinder-849143-13-iscsi devstack@n-api.service[125788]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 00:19:11.828482 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 00:19:11.829852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 00:19:12.980341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 00:19:12.980341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: from cryptography.utils import int_from_bytes Oct 12 00:19:12.980982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 00:19:12.980982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: from cryptography.utils import int_from_bytes Oct 12 00:19:12.981119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 00:19:12.981119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: from cryptography.utils import int_from_bytes Oct 12 00:19:12.981119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 00:19:12.981119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: from cryptography.utils import int_from_bytes Oct 12 00:19:15.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 00:19:15.412925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 00:19:15.413029 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 00:19:15.413427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 00:19:15.413523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 00:19:15.413606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 00:19:15.413716 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 00:19:15.413867 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 00:19:15.414105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.414211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 00:19:15.414405 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 00:19:15.414525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.414735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.414837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.415050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.415151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.415392 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.415501 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.415709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.415813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.416043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.416133 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.416348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.416457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.416668 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.416768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.416925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.417015 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.417238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.417330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.417553 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.417688 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-13-iscsi {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.417874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.418013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.418323 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.418427 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-13-iscsi {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.418650 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.418752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.418964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.419078 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.419288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.419436 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.419635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.419736 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.419951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.420060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.420325 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.420507 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.420656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.421829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.422092 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.422286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.422466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.422648 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.422835 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.423050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.423236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.424808 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425242 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425333 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425669 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425840 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.425935 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426019 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426108 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-13-iscsi {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-13-iscsi {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426306 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426524 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426610 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426869 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.426953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427133 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427332 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427611 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.427955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.428032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.428776 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.428897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.428978 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429072 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429160 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429552 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429642 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429732 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429732 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.429971 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.430083 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.430272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.430396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.430579 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.430683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.430833 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.430933 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.431146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.431244 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.431496 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.431605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.431823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.431920 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.432076 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.432165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.432329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.432429 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.432624 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.432720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.432951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.433048 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.433258 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.433360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.433568 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.433668 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.433878 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.433974 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.434183 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.434273 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.434492 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.434588 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.434795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.434884 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.435103 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.435194 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.435432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.435523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.435746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.435844 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.436058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.436155 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.436375 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.436463 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.436681 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.436771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.436998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.437095 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.437325 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.437420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.437626 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.437725 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.437934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.438028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.438263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.438352 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.438578 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.438695 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.438899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.439027 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.439762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.439866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.440082 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.440187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.440394 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.440497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.440700 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.440803 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.441004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.441109 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.441312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.441404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.441636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.441733 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.441936 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.442027 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.442188 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.442279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.442492 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.442588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.442797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.442888 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.443104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.443198 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.443426 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.443532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.443735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.443837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.444039 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.444141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.444340 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.444431 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.444642 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.444740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.444945 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.445041 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.445248 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.445338 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.445552 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.445651 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.445856 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.445947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.446160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.446258 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.446462 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.446557 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.446769 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.446859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.447072 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.447184 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.447387 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.447480 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.447706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.447804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.448024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.448122 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.448331 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.448429 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.448637 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.448735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.448988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.449106 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.449248 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.449350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.449560 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.449650 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.449863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.449965 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.450171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.450261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.450494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.450618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.450785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.450899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.451090 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.451195 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.451415 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.451509 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.451721 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.451812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.452027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.452119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.452333 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.452422 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.452631 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.452728 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.452935 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.453033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.453248 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.453345 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.453543 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.453640 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.453847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.453950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.454150 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.454239 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.454449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.454564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.454802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.455538 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.455627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.455709 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.455921 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.456021 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.456227 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.456319 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.456530 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.456636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.456849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.456946 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.457169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.457266 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.457477 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.457646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.457784 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.457875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.458088 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.458185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.458393 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.458492 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.458719 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 00:19:15.458810 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.459094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.459203 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.459393 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.459487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.459711 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.459861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.460043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.460142 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.460373 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.460465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.460693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.460796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.461001 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.461098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.461612 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.461712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.461712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.461862 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.461932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.462008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.462220 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.462311 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.462530 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.462620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.462840 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.462939 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.463153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.463259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.463502 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.463597 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.463820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.463921 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.464137 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.464231 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.464455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.464544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.464764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.464862 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.465078 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.465169 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.465401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.465497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.465718 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.465818 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.466031 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.466122 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.466342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.466438 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.466685 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.466774 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.466996 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.467086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.467319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.467442 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.467666 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.467766 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.467978 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.468067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.468288 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.468378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.468599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.468706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.468909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.468998 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.469245 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.469346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.469555 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.469658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.469891 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.469983 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.470176 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.470266 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.470523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.470625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.470838 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.470939 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.471149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.471249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.471484 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.471591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.471800 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.471899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.472116 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.472215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.472429 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.472521 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.472749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.472838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.473073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.473170 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.473390 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.473488 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.473700 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.473790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.474013 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.474101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.474322 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.474420 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.474634 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.474735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.474943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.475039 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.475250 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.475347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.475579 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.475669 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.475889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.475990 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.476198 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.476298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.476511 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.476601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.476818 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.476916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.477145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.477234 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.477455 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.477545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.477774 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.477871 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.478084 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.478182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.478397 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.478495 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.478707 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.478810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.479020 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.479116 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.479333 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.479464 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.479663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.479753 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.479972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.480068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.480276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.480366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.480589 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.480685 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.480902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.481025 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.481209 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.481322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.481534 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.481643 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.481822 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.481912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.482127 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.482217 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.482437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.482543 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.482749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.482854 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.483056 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.483157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.483428 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.483523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.483697 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.483786 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.484010 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.484178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.484319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.484412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.484627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.484717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.484937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.485035 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.485273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.485361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.485576 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.485666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.485897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.485999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.486252 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.486438 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.486579 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.486940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.487046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.487254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.487500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.487596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.487907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.487992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.488218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.488455 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.488545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.488772 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.488863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.489084 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.489188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.489415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.489526 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.489706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.489794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.490012 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.490112 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.490316 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.490412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.490623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.490720 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.490948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.491045 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.491246 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.491358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.491583 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.491686 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.491890 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.491988 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.492197 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.492288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.492503 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.492594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.492849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.492948 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.493158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.493255 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.493495 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.493584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.493823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.493914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.494137 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.494226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.494453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.494546 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.494762 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.494851 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.495074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.495164 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.495400 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.495508 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.495717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.495806 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.496027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.496134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.496337 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.496443 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.496656 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.496746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.496967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.497056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.497289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.497388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.497601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.497690 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.497922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.498018 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.498230 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.498333 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.498549 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.498646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.498857 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.498992 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.499173 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.499271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.499545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.499663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.499870 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.499968 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.500185 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.500289 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.500507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.500596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.500816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.500913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.501127 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.501223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.501437 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.501547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.502262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.502348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.502572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.502670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.502885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.502975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.503204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.503305 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.503537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.503641 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.503856 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.503948 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.504167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.504272 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.504485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.504577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.504795 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.504892 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.505111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.505216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.505417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.505515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.505730 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.505819 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.506055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.506158 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.506366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.506456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.506684 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.506781 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.506995 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.507086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.507303 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.507414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.507644 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.507736 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.507955 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.508053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.508266 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.508363 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.508581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.508670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.508891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.508980 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.509200 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.509297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.509511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.509614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.509817 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.509918 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.510120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.510211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.510424 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.510529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.510731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.510827 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.511036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.511133 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.511340 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.511483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.511670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.511780 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.511977 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.512068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.512297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.512398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.512607 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.512698 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.512912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.513007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.513221 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.513326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.513524 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.513630 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.513829 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.513918 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.514135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.514584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.514720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.514834 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.515028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.515130 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.515332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.515478 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.515660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.515751 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.515992 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.516082 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.516299 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.516397 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.516603 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.516693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.516919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.517009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.517254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.517836 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.518099 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.518189 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.518415 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.518506 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.518738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.518839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.519050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.519148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.519360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.519483 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.519696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.519815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.520012 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.520110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.520344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.520447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.520629 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.520721 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.520938 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.521036 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.521247 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.521342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.521558 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.521647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.521862 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.521959 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.522167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.522264 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.522472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.522564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.522776 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.522873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.523085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.523357 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.523510 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.523718 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.523980 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.524078 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.524316 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.524408 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.524634 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.524733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.524956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.525072 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.525300 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.525392 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.525618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.525710 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.525933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.526024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.526245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.526348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.526554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.526645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.526861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.526952 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.527168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.527260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.527502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.527608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.527807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.527898 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.528115 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.528205 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.528414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.528499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.528723 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.528825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.529019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.529111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.529321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.529419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.529620 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.529715 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.529924 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.530011 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.530223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.530320 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.530524 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.530629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.530838 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.530936 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.531142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.531241 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.531476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.531588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.531782 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.531870 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.532087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.532183 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.532396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.532499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.532699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.532789 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.533030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.533121 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.533333 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.533433 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.533678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.533776 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.533982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.534073 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.534319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.534417 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.534633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.534723 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.534960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.535111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.535262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.535353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.535592 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.535677 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.539218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.542515 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543340 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543445 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543569 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543655 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543803 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543878 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.543956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544039 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544176 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544390 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544535 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544681 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544748 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544902 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.544971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545038 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545179 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545331 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545398 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545472 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.545982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546063 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546133 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546200 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546268 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546477 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546587 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546674 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546756 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546845 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.546936 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547231 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547475 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547562 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547652 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547744 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547917 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.547998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548517 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548600 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548682 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548819 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.548913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.549004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.549094 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.549360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.549553 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.549640 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.549723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.549818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.549917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550008 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550188 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550281 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550365 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550551 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550910 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.550991 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551080 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551567 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551639 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551798 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.551934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552023 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552161 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552255 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552345 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552429 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.552855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.553017 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.553017 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.553254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.553339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.553428 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.553606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.553706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.553916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.554008 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.554225 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.554315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.554535 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.554626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.554839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.554938 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.555138 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.555237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.555477 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.555575 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.555790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.555884 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.556098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.556189 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.556401 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.556499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.556705 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.556800 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.557022 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.557113 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.557343 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.557491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.557625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.557741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.557943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.558040 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.558260 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.558361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.558565 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.558663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.558871 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.559006 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.559178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.559279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.559510 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.559603 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.559822 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.559914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.560133 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.560226 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.560439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.560541 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.560752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.560844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.561063 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.561155 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.561370 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.561506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.561680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.561773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.561987 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.562086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.562292 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.562385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.562602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.562703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.562909 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.563013 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.563213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.563306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.563558 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.563670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.563865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.563958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.564694 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.564798 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.565001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.565106 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.565304 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.565396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.565616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.565709 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.565924 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.566054 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.566358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.566449 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.566673 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.566775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.566981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.567081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.567285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.567399 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.567623 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.567724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.567932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.568025 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.568248 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.568338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.568559 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.568650 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.568860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.568982 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.569278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.569373 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.569592 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.569684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.569905 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.570006 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.570215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.570304 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.570519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.570609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.570822 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.570913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.571135 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.571227 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.571485 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.571641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.571781 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.571870 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.572088 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.572181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.572390 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.572492 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.572710 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.572803 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.573013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.573103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.573334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.573440 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.573746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.573878 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.574057 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.574161 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.574361 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.574490 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.574779 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.574908 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.575091 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.575221 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.575424 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.575535 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.575750 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.575843 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.576072 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.576182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.576380 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.576470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.576689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.576827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.577001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.577102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.577309 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.577399 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.577634 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.577734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.577945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.578036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.578253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.578344 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.578563 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.578652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.578866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.578958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.579190 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.579291 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.579532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.579627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.580383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.580498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.580711 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.580814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.581130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.581236 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.581445 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.581537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.581756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.581901 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.582081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.582241 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.582389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.582541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.582700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.582795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.583004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.583169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.583315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.583442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.583649 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.583747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.583961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.584071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.584272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.584363 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.584581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.584673 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.584894 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.584984 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.585203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.585293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.585512 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.585604 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.585816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.585907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.586120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.586212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.586435 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.586526 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.586736 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.586827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.587057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.587167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.587402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.587500 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.587717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.587819 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.588030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.588124 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.588335 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.588440 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.588658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.588750 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.588967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.589065 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.589270 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.589375 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.589576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.589674 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.589878 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.589970 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.590222 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.590326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.590536 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.590628 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.590859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.590959 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.591189 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.591295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.591525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.591628 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.591861 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.591963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.592192 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.592326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.592518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.592656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.592830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.592922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.593139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.593231 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.593457 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.593549 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.593762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.593854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.594073 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.594166 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.594376 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.594474 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.594684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.594781 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.594986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.595085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.595294 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.595447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.595645 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.595774 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.595950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.596053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.596248 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.596339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.596555 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.596656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.596860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.596960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.597175 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.597276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.597480 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.597620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.597804 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.597931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.598112 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.598210 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.598418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.598523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.598724 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.598821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.599026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.599117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.599389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.599484 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.599712 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.599814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.600042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.600195 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.600360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.600670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.600770 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.600990 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.601089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.601307 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.601413 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.601623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.601714 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.601937 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.602033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.602253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.602359 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.602568 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.602672 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.602882 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.602974 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.603192 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.603294 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.603532 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.603627 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.603846 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.603937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.604163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.604257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.604712 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.604813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.605044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.605136 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.605359 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.605457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.605674 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.605775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.605987 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.606079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.606302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.606402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.606612 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.606703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.606923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.607025 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.607235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.607328 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.607572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.607666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.607885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.607989 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.608213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.608315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.608537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.608630 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.608862 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.608964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.609199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.609298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.609519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.609619 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.609837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.609937 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.610149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.610240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.610464 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.610562 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.610820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.610914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.611160 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.611255 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.611491 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.611602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.611812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.611946 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.612126 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.612218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.612443 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.612656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.612752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.612886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.613053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.613154 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.613369 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.613461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.613697 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.613788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.613994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.614099 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.614302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.614395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.614617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.616920 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617166 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617417 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617600 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617684 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617776 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617869 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.617960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618052 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618227 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618323 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618829 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.618923 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619008 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619092 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619175 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619266 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619489 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619582 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619758 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619851 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.619948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.620033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.620115 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.620205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.620387 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.620499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.620701 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.620795 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.621010 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.621110 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.621335 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.621427 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.621649 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.621742 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.621956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.622097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.622276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.622415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.622586 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.622678 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.623122 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.623259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.623500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.623615 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.623823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.623916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.624150 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.624251 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.624476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.624577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.624794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.624887 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.625105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.625206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.625434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.625632 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.625723 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.625813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.626030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.626124 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.626347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.626454 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.627173 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.627276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.627506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.627610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.627813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.627912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.628127 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.628220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.628438 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.628545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.628744 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.628859 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.629055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.629154 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.629360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.629458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.629685 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.629776 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.629992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.630092 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.630298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.630390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.630648 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.630756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.630917 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.631009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.631223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.631329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.631554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.631657 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.631864 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.631962 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.632167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.632268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.632481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.632581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.632785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.632875 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.633179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.633283 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.633485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.633581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.633799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.633892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.634152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.634262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.634462 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.634553 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.634770 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.634909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.635093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.635190 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.635424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.635542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.635736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.635833 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.636059 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.636161 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.636377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.636469 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.636706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.636805 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.637025 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.637119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.637342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.637436 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.637690 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.637781 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.638009 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.638104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.638546 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.638647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.638885 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.638995 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.639212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.639586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.639826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.639919 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.640164 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.640269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.640474 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.640604 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.640784 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.640876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.641091 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.641196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.641419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.641512 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.641733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.641838 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.642046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.642155 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.642909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.643019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.643230 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.643330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.643581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.643678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.643893 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.643984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.644207 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.644307 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.644519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.644658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.644831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.644930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.645138 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.645231 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.645449 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.645541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.645757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.645856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.646071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.646173 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.646382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.646482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.646699 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.646800 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.647036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.647141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.647356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.647485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.647697 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.647801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.648013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.648117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.648330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.648423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.648643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.648735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.648951 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.649050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.649261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.649361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.649571 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.649671 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.649890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.649984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.650222 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.650323 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.650539 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.650631 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.650849 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.650948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.651269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.651426 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.651612 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.651721 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.651934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.652027 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.652254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.652342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.652565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.652672 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.652888 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.652994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.653212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.653342 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.653519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.653656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.653840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.653940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.654153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.654244 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.654481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.654573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.654823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.654922 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.655151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.655252 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.655499 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.655608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.655810 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.655948 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.656116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.656209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.656423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.656517 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.656736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.656828 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.657053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.657155 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.657363 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.657463 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.657667 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.657757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.657999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.658187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.658313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.658401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.658593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.658686 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.658900 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.659010 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.659203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.659295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.659547 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.659653 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.659859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.659961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.660162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.660253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.660465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.660563 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.660766 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.660900 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.661069 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.661169 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.661369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.661468 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.661671 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.661764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.661979 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.662079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.662281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.662373 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.662585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.662682 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.662888 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.662986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.663189 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.663280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.663514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.663622 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.663846 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.663950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.664179 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.664285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.664494 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.664585 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.664817 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.664910 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.665126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.665226 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.665445 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.665537 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.665756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.665847 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.666077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.666182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.666399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.666528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.666714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.666810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.667023 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.667129 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.667356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.667544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.667697 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.667837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.668007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.668100 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.668322 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.668424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.668633 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.668735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.668943 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.669043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.669250 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.669348 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.669579 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.669669 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.669904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.670004 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.670213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.670313 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.670539 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.670646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.670858 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.670994 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.671177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.671269 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.671518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.671635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.671834 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.671939 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.672161 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.672251 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.672472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.672684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.672780 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.672863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.673079 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.673172 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.673392 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.673507 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.673728 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.673829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.674047 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.674145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.674354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.674454 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.674666 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.674759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.674982 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.675079 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.675295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.675403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.675646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.675751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.675973 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.676109 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.676283 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.676375 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.676605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.676702 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.676929 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.677035 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.677277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.677370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.677591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.677691 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.677932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.678035 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.678258 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.678361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.678576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.678674 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.678887 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.679028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.679192 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.679291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 00:19:15.679456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 00:19:15.679563 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125809) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 00:19:15.741029 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO dbcounter [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Registered counter for database nova_api Oct 12 00:19:15.741214 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO dbcounter [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Registered counter for database nova_api Oct 12 00:19:15.761742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_db.sqlalchemy.engines [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:19:15.763153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_db.sqlalchemy.engines [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:19:15.769485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writer thread running {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:19:15.770547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writer thread running {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:19:15.824702 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.context [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b25f271-a621-44c9-82e0-2017e2b25b27(cell1) {{(pid=125810) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 00:19:15.825814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.context [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2b25f271-a621-44c9-82e0-2017e2b25b27(cell1) {{(pid=125809) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 00:19:15.828696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:19:15.829163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:19:15.830355 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:19:15.830838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:19:15.831482 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:19:15.832141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:19:15.832518 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:19:15.832638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:19:15.833247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:19:15.833704 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:19:15.834571 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:19:15.835737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:19:15.836772 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO dbcounter [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Registered counter for database nova_cell0 Oct 12 00:19:15.837761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO dbcounter [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Registered counter for database nova_cell0 Oct 12 00:19:15.841965 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO dbcounter [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Registered counter for database nova_cell1 Oct 12 00:19:15.842095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO dbcounter [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Registered counter for database nova_cell1 Oct 12 00:19:15.848487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_db.sqlalchemy.engines [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:19:15.850188 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_db.sqlalchemy.engines [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:19:15.852246 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_db.sqlalchemy.engines [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:19:15.853976 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_db.sqlalchemy.engines [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:19:15.855686 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writer thread running {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:19:15.860054 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writer thread running {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:19:15.860914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writer thread running {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:19:15.862643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writer thread running {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:19:16.006258 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO dbcounter [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Registered counter for database nova_cell0 Oct 12 00:19:16.009941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO dbcounter [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Registered counter for database nova_cell0 Oct 12 00:19:16.013805 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_db.sqlalchemy.engines [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:19:16.019329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_db.sqlalchemy.engines [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125809) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 00:19:16.019722 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writer thread running {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:19:16.024005 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writer thread running {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 00:19:16.342244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: WARNING keystonemiddleware.auth_token [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 00:19:16.350178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: WARNING keystonemiddleware.auth_token [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 00:19:16.353128 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: WARNING keystonemiddleware.auth_token [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 00:19:16.360683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: WARNING keystonemiddleware.auth_token [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 00:19:16.699435 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: WARNING keystonemiddleware.auth_token [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 00:19:16.706201 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: WARNING keystonemiddleware.auth_token [None req-b69482cd-5cca-4f4b-8e9b-7ad690999b33 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 00:19:16.711526 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5618881289c0 pid: 125809 (default app) Oct 12 00:19:16.715016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: WARNING keystonemiddleware.auth_token [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 00:19:16.721766 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: WARNING keystonemiddleware.auth_token [None req-a8be2a9f-eec9-4b3b-ae07-87e22c805497 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 00:19:16.727180 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5618881289c0 pid: 125810 (default app) Oct 12 00:19:53.951064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:53.953494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:53.954330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:53.955109 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:55.154081 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-97d35431-a4a3-41e6-9e3d-cefad64a10aa tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Action: 'create', calling method: .version_select at 0x7f2fe9e5b550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-341323855", "metadata": {"Type": "work"}}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-97d35431-a4a3-41e6-9e3d-cefad64a10aa tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Request method failure captured: Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 121 Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRggp7YdmBOkKsjdy6V1rm31lUTjGWeehnTlzAM1397YQwhDiWaHl7jWdZJuexTBTSg0tl9KWPG3LBA2Bw5BUYZGv6fCopGjzXOzbevzhWtUf5UA6st5BYuUKFBvfOzZZH3wS1zoDyRZIZVMuUVSTB4VTy-H3WRRCpsWG0e3NL7QK7So Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:19:55.162621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_532f356fff2a4e8db81955a7071bdb9b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: fb2ff6db932541aaaa90bbec30091aa0 Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-341323855", "metadata": {"Type": "work"}}} Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: Oct 12 00:19:55.164258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-341323855', 'metadata': {'Type': 'work'}}}} Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise error Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi '#$%' Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:19:55.165067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 00:19:55.166356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 00:19:55.168937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 00:19:55.168937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.168937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-97d35431-a4a3-41e6-9e3d-cefad64a10aa tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:19:55.169388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-97d35431-a4a3-41e6-9e3d-cefad64a10aa tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.244304 Oct 12 00:19:55.169754 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Oct 12 00:19:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:19:55.182991 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:55.184206 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:55.185226 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:55.195193 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:19:55.657428 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-514eb7b8-4948-4f0e-b0d0-ceaad8e070c5 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Action: 'create', calling method: .version_select at 0x7f2fe9eaa310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2081914702", "metadata": {"Type": "work"}}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-514eb7b8-4948-4f0e-b0d0-ceaad8e070c5 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Request method failure captured: Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 120 Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRggp7YdmBOkKsjdy6V1rm31lUTjGWeehnTlzAM1397YQwhDiWaHl7jWdZJuexTBTSg0tl9KWPG3LBA2Bw5BUYZGv6fCopGjzXOzbevzhWtUf5UA6st5BYuUKFBvfOzZZH3wS1zoDyRZIZVMuUVSTB4VTy-H3WRRCpsWG0e3NL7QK7So Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:19:55.671289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_532f356fff2a4e8db81955a7071bdb9b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: fb2ff6db932541aaaa90bbec30091aa0 Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2081914702", "metadata": {"Type": "work"}}} Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: Oct 12 00:19:55.672876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2081914702', 'metadata': {'Type': 'work'}}}} Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise error Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi '0' Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:19:55.673802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 00:19:55.675601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 00:19:55.677117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 00:19:55.677117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.681089 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-514eb7b8-4948-4f0e-b0d0-ceaad8e070c5 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:19:55.683279 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-514eb7b8-4948-4f0e-b0d0-ceaad8e070c5 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.506331 Oct 12 00:19:55.689624 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Oct 12 00:19:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 510 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:19:55.697190 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ca56be00-cf48-44da-ac7c-3548e23047ae tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Action: 'create', calling method: .version_select at 0x7f2fe9e5be50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-858283321", "metadata": {"Type": "work"}}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ca56be00-cf48-44da-ac7c-3548e23047ae tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Request method failure captured: Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 118 Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRggp7YdmBOkKsjdy6V1rm31lUTjGWeehnTlzAM1397YQwhDiWaHl7jWdZJuexTBTSg0tl9KWPG3LBA2Bw5BUYZGv6fCopGjzXOzbevzhWtUf5UA6st5BYuUKFBvfOzZZH3wS1zoDyRZIZVMuUVSTB4VTy-H3WRRCpsWG0e3NL7QK7So Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:19:55.703601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_532f356fff2a4e8db81955a7071bdb9b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: fb2ff6db932541aaaa90bbec30091aa0 Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-858283321", "metadata": {"Type": "work"}}} Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: Oct 12 00:19:55.705662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-858283321', 'metadata': {'Type': 'work'}}}} Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise error Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi '' Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:19:55.706576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 00:19:55.707937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 00:19:55.709313 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 00:19:55.709313 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:55.709313 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ca56be00-cf48-44da-ac7c-3548e23047ae tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:19:55.709313 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ca56be00-cf48-44da-ac7c-3548e23047ae tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012456 Oct 12 00:19:55.711703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Oct 12 00:19:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:19:55.733879 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e6dda899-7829-4335-8a8a-823df6cc2836 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Calling method '.version_select at 0x7f2fe9eaac10>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:19:56.399431 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-e6dda899-7829-4335-8a8a-823df6cc2836 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] HTTP exception thrown: Volume tempest-invalid-973725028 could not be found. Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e6dda899-7829-4335-8a8a-823df6cc2836 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Request method failure captured: Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-973725028 HTTP/1.1 Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRggp7YdmBOkKsjdy6V1rm31lUTjGWeehnTlzAM1397YQwhDiWaHl7jWdZJuexTBTSg0tl9KWPG3LBA2Bw5BUYZGv6fCopGjzXOzbevzhWtUf5UA6st5BYuUKFBvfOzZZH3wS1zoDyRZIZVMuUVSTB4VTy-H3WRRCpsWG0e3NL7QK7So Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:19:56.403895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_532f356fff2a4e8db81955a7071bdb9b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: fb2ff6db932541aaaa90bbec30091aa0 Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Volume tempest-invalid-973725028 could not be found. Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'tempest-invalid-973725028'} Oct 12 00:19:56.405441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-973725028 could not be found. (HTTP 404) (Request-ID: req-35c3c253-0429-4c08-9224-16357e76d112) Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:56.406303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 00:19:56.407771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-973725028 could not be found. Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:19:56.409799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-973725028 could not be found. Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-973725028 could not be found. Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e6dda899-7829-4335-8a8a-823df6cc2836 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Returning 404 to user: Volume tempest-invalid-973725028 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:19:56.411957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e6dda899-7829-4335-8a8a-823df6cc2836 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-973725028" status: 404 len: 98 microversion: 2.1 time: 0.698996 Oct 12 00:19:56.413631 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1215 bytes} [Wed Oct 12 00:19:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-973725028 => generated 98 bytes in 703 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 00:19:56.424151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ecd38063-3050-4856-908d-9ba9354c6b52 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005340 Oct 12 00:19:56.428702 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1140 bytes} [Wed Oct 12 00:19:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 00:19:56.434981 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6d83f32f-0dc9-445a-b0d3-5edf05d32b06 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004962 Oct 12 00:19:56.435740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 3/6] 10.222.0.36 () {58 vars in 1137 bytes} [Wed Oct 12 00:19:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 12 00:19:56.464516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ebed1cef-87e6-4ad6-ba2d-057b28fee657 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Calling method '.version_select at 0x7f2fe9d164c0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:19:56.930079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-ebed1cef-87e6-4ad6-ba2d-057b28fee657 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] HTTP exception thrown: Volume 14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce could not be found. Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ebed1cef-87e6-4ad6-ba2d-057b28fee657 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Request method failure captured: Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/os-volumes/14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce HTTP/1.1 Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRggp7YdmBOkKsjdy6V1rm31lUTjGWeehnTlzAM1397YQwhDiWaHl7jWdZJuexTBTSg0tl9KWPG3LBA2Bw5BUYZGv6fCopGjzXOzbevzhWtUf5UA6st5BYuUKFBvfOzZZH3wS1zoDyRZIZVMuUVSTB4VTy-H3WRRCpsWG0e3NL7QK7So Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:19:56.934180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_532f356fff2a4e8db81955a7071bdb9b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: fb2ff6db932541aaaa90bbec30091aa0 Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Volume 14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce could not be found. Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce'} Oct 12 00:19:56.935737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce could not be found. (HTTP 404) (Request-ID: req-c5ad7772-b144-437d-be71-9d787dc12d19) Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:56.936649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 00:19:56.937952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce could not be found. Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 00:19:56.939302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce could not be found. Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce could not be found. Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:19:56.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ebed1cef-87e6-4ad6-ba2d-057b28fee657 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Returning 404 to user: Volume 14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:19:56.944615 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ebed1cef-87e6-4ad6-ba2d-057b28fee657 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce" status: 404 len: 109 microversion: 2.1 time: 0.500304 Oct 12 00:19:56.945652 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:19:56 2022] DELETE /compute/v2.1/os-volumes/14e09e8a-7a3f-46d1-afb5-c91c6bc3ddce => generated 109 bytes in 504 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:19:56.955572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-729fff88-37a7-4268-b08c-6b20f8f4fc77 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Calling method '.version_select at 0x7f2fea68b940>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:19:57.131495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-729fff88-37a7-4268-b08c-6b20f8f4fc77 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] HTTP exception thrown: Volume 770767c8-dc0e-44f5-83fb-02161b85a500 could not be found. Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-729fff88-37a7-4268-b08c-6b20f8f4fc77 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Request method failure captured: Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/os-volumes/770767c8-dc0e-44f5-83fb-02161b85a500 HTTP/1.1 Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRggp7YdmBOkKsjdy6V1rm31lUTjGWeehnTlzAM1397YQwhDiWaHl7jWdZJuexTBTSg0tl9KWPG3LBA2Bw5BUYZGv6fCopGjzXOzbevzhWtUf5UA6st5BYuUKFBvfOzZZH3wS1zoDyRZIZVMuUVSTB4VTy-H3WRRCpsWG0e3NL7QK7So Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:19:57.133696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_532f356fff2a4e8db81955a7071bdb9b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/532f356fff2a4e8db81955a7071bdb9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 532f356fff2a4e8db81955a7071bdb9b Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesNegativeTest-1305864147 Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: fb2ff6db932541aaaa90bbec30091aa0 Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesNegativeTest-1305864147-project Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Volume 770767c8-dc0e-44f5-83fb-02161b85a500 could not be found. Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '770767c8-dc0e-44f5-83fb-02161b85a500'} Oct 12 00:19:57.135246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 770767c8-dc0e-44f5-83fb-02161b85a500 could not be found. (HTTP 404) (Request-ID: req-9abff0e8-487e-4304-89d8-56682ff87a7c) Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:57.148184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:19:57.149605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 770767c8-dc0e-44f5-83fb-02161b85a500 could not be found. Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 00:19:57.150889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 770767c8-dc0e-44f5-83fb-02161b85a500 could not be found. Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 770767c8-dc0e-44f5-83fb-02161b85a500 could not be found. Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-729fff88-37a7-4268-b08c-6b20f8f4fc77 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] Returning 404 to user: Volume 770767c8-dc0e-44f5-83fb-02161b85a500 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-729fff88-37a7-4268-b08c-6b20f8f4fc77 tempest-VolumesNegativeTest-1305864147 tempest-VolumesNegativeTest-1305864147-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/770767c8-dc0e-44f5-83fb-02161b85a500" status: 404 len: 109 microversion: 2.1 time: 0.185933 Oct 12 00:19:57.152944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:19:56 2022] GET /compute/v2.1/os-volumes/770767c8-dc0e-44f5-83fb-02161b85a500 => generated 109 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:20:07.644399 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a89e9c1c-5417-4862-9076-31ebbbc47cf4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'create', calling method: .version_select at 0x7f2fe9c9ef70>, body: {"keypair": {"name": "tempest-keypair-2082396615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+XqKEJYZUJqwK6SdTWwhmqoWU6Xc1OcJ/22D+iEgi0jud3jZaddC0n7RW124lB7IPiae+RSjHOhN/GEe8EzHGuluJsZdBrFiCp5YsMGW360oPseYHbDyjmGHAJTXJSwg=="}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:07.797510 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-a89e9c1c-5417-4862-9076-31ebbbc47cf4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Getting quotas for project 54567f4ea839415a94397e13f93d71cc. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:20:07.816921 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-a89e9c1c-5417-4862-9076-31ebbbc47cf4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Getting quotas for user bca53aca7b134df1949deb10858f14d0 and project 54567f4ea839415a94397e13f93d71cc. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:20:08.028532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a89e9c1c-5417-4862-9076-31ebbbc47cf4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.889904 Oct 12 00:20:08.029944 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 5/9] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:20:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:09.390830 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1587913535", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:09.555954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] validate_networks() for [('973be902-a368-4ae5-bb3f-30b2cbc52bd3', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:20:10.148122 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-71ae7abf-90d0-4403-b72e-b6dea19b339a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: .version_select at 0x7f2fe9c1c790>, body: {"keypair": {"name": "tempest-keypair-212682822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJQ4KyvvTmwpVYFv0jbVwnPhqMmbOdrVcrq51Cnzigztk3IWH3ABBEseLxb1XRC4HnA5M43Z4dP3r0H2GY8i5NSUyg3jvN9WPNRHJ8+EBMqvZlr37lcudCxTIIgfWyvkQ=="}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:10.203844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-71ae7abf-90d0-4403-b72e-b6dea19b339a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for project 10160596b45c49249155b0c2585e70bb. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:20:10.213909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-71ae7abf-90d0-4403-b72e-b6dea19b339a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for user de766cb582ba4c18b1fda9bf4ad43f65 and project 10160596b45c49249155b0c2585e70bb. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:20:10.340806 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-71ae7abf-90d0-4403-b72e-b6dea19b339a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.755093 Oct 12 00:20:10.341827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 6/10] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:20:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:11.864549 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2020961589", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "networks": [{"uuid": "cc748322-3660-40ca-ad32-305cc5ab6021"}]}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:11.990022 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] validate_networks() for [('cc748322-3660-40ca-ad32-305cc5ab6021', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:20:12.474401 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:20:12.474888 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:20:12.475541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:20:12.476051 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:20:12.477061 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:20:12.530514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:12.531006 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:12.531472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:12.532202 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:12.532655 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:12.533211 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:12.608586 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Getting quotas for project 38c7ea1f3f9848b484a56cf74a2bd129. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:20:12.615483 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Getting quotas for user cdd87151f3af4a3bb1c3815db5d0e8fa and project 38c7ea1f3f9848b484a56cf74a2bd129. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:20:12.640578 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:20:12.643407 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:20:12.880930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-15cb5ab3-fe3a-41e1-bcfd-0cd422543dff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.516900 Oct 12 00:20:12.881890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 5/11] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:20:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 4519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 00:20:12.897970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-224802bb-afb4-4c6f-a163-e99aae100465 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:12.899002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-224802bb-afb4-4c6f-a163-e99aae100465 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:13.099889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-224802bb-afb4-4c6f-a163-e99aae100465 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:13.150564 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-224802bb-afb4-4c6f-a163-e99aae100465 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1222 microversion: 2.1 time: 0.258991 Oct 12 00:20:13.151151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:12 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:13.462961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-467192319", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:13.588957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] validate_networks() for [('973be902-a368-4ae5-bb3f-30b2cbc52bd3', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:20:14.737309 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:20:14.737845 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:20:14.738279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:20:14.738746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:20:14.739220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:20:14.768945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:14.769462 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:14.769913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:14.774302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:14.774843 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:14.776746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:14.863170 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Getting quotas for project bbfafa65b93241bcb62d41018f6ccd1f. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:20:14.892712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Getting quotas for user b4dba90d485945e1821be4667d5a5bc9 and project bbfafa65b93241bcb62d41018f6ccd1f. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:20:14.911791 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:20:14.918346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:20:15.187182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f23c1eac-a1ad-4b6c-9422-3159d13a5f2d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.976335 Oct 12 00:20:15.200810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 7/13] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:20:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 00:20:15.222656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-121081610", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "499fb018-9e00-4ed3-b355-c8bccdf8c8f0"}], "security_groups": [{"name": "tempest-securitygroup--935458701"}], "key_name": "tempest-keypair-2082396615", "user_data": "}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:15.598194 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] validate_networks() for [('499fb018-9e00-4ed3-b355-c8bccdf8c8f0', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:20:15.711163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:20:15.712833 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:20:15.713322 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:20:15.713737 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:20:15.714349 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:20:15.735324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:15.735864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:15.736386 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:15.744597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:15.745132 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:15.745587 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:15.791652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Getting quotas for project 38c7ea1f3f9848b484a56cf74a2bd129. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:20:15.797691 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Getting quotas for user cdd87151f3af4a3bb1c3815db5d0e8fa and project 38c7ea1f3f9848b484a56cf74a2bd129. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:20:15.900473 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:20:15.900473 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:20:16.160955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e3cf6ed1-3fce-4553-815c-43c818b07d4b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.702498 Oct 12 00:20:16.167823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 7/14] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:20:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 00:20:16.173622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0b5feb2c-af66-4614-8716-fbe14ed89ac6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:16.174420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0b5feb2c-af66-4614-8716-fbe14ed89ac6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:16.296021 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0b5feb2c-af66-4614-8716-fbe14ed89ac6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:16.307649 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0b5feb2c-af66-4614-8716-fbe14ed89ac6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1215 microversion: 2.1 time: 0.136978 Oct 12 00:20:16.307649 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 8/15] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:16 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:16.320321 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dca52b3b-06e8-47de-b26d-a0ce0ea4f748 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:16.320941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dca52b3b-06e8-47de-b26d-a0ce0ea4f748 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:16.446179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dca52b3b-06e8-47de-b26d-a0ce0ea4f748 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:16.464529 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dca52b3b-06e8-47de-b26d-a0ce0ea4f748 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1221 microversion: 2.1 time: 0.156621 Oct 12 00:20:16.466060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:16 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:16.645944 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:20:16.647326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:20:16.648014 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:20:16.648641 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:20:16.649470 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:20:16.669242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:16.673196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:16.673196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:16.673196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:16.675562 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:16.676035 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:16.715903 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Getting quotas for project 54567f4ea839415a94397e13f93d71cc. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:20:16.722210 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Getting quotas for user bca53aca7b134df1949deb10858f14d0 and project 54567f4ea839415a94397e13f93d71cc. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:20:16.738889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:20:16.743900 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:20:16.954821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-614235728", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7f2d8cc-4d82-4295-a149-404a55bcd20c"}], "security_groups": [{"name": "tempest-securitygroup--165868029"}], "key_name": "tempest-keypair-212682822", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:17.034485 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0059b9da-6c16-4225-b039-728586fe03c9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.822708 Oct 12 00:20:17.035483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 8/17] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:20:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:20:17.052452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6cef71f9-0db6-47ec-b867-bc24b44ab667 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:17.053065 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6cef71f9-0db6-47ec-b867-bc24b44ab667 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:17.174120 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6cef71f9-0db6-47ec-b867-bc24b44ab667 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:17.233178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6cef71f9-0db6-47ec-b867-bc24b44ab667 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1237 microversion: 2.1 time: 0.164443 Oct 12 00:20:17.238241 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 9/18] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:17 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1237 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:17.288230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] validate_networks() for [('a7f2d8cc-4d82-4295-a149-404a55bcd20c', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:20:17.336335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9e5ae5c8-beec-4ab4-949e-9e56c88a3090 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:17.337550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9e5ae5c8-beec-4ab4-949e-9e56c88a3090 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:17.460882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9e5ae5c8-beec-4ab4-949e-9e56c88a3090 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:17.468933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9e5ae5c8-beec-4ab4-949e-9e56c88a3090 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1215 microversion: 2.1 time: 0.138360 Oct 12 00:20:17.473288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 10/19] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:17 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:17.509942 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c3f85cb3-e51b-4797-9a2f-00dac684a619 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:17.512128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c3f85cb3-e51b-4797-9a2f-00dac684a619 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:17.604147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c3f85cb3-e51b-4797-9a2f-00dac684a619 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:17.621506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c3f85cb3-e51b-4797-9a2f-00dac684a619 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1221 microversion: 2.1 time: 0.116641 Oct 12 00:20:17.622184 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 11/20] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:17 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:18.263171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-46f24595-a47a-4fc0-8f06-5723f43b3dd4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:18.264605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-46f24595-a47a-4fc0-8f06-5723f43b3dd4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:18.364762 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:20:18.365356 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:20:18.365641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:20:18.366231 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:20:18.366689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:20:18.381005 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:18.388481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:18.388481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:18.388481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:18.388481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:18.389593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:18.408581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for project 10160596b45c49249155b0c2585e70bb. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:20:18.416926 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for user de766cb582ba4c18b1fda9bf4ad43f65 and project 10160596b45c49249155b0c2585e70bb. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:20:18.432165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-46f24595-a47a-4fc0-8f06-5723f43b3dd4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:18.453742 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-46f24595-a47a-4fc0-8f06-5723f43b3dd4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1237 microversion: 2.1 time: 0.191590 Oct 12 00:20:18.468053 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 12/21] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:18 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1237 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:18.487561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:20:18.491012 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:20:18.507146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:18.508049 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:18.525214 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:18.525879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:18.528067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:18.530360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:18.531288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:18.533344 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:18.735200 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ee833a8a-fa8d-4648-81e3-fa8fa4f21dd4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.788187 Oct 12 00:20:18.738573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 10/22] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:20:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 00:20:18.755116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:18.757203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:18.788007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:18.790366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:18.790366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:18.791087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:18.794822 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:18.797115 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:18.831900 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:18.856219 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1b776fa6-99cf-43dc-a932-3ec218873805 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1219 microversion: 2.1 time: 0.359405 Oct 12 00:20:18.877124 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 13/23] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:18 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1219 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:18.882289 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1f73de75-4a4e-4e7f-b03e-eefca4c902bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:18.896330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1f73de75-4a4e-4e7f-b03e-eefca4c902bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:19.031843 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1f73de75-4a4e-4e7f-b03e-eefca4c902bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:19.043740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1f73de75-4a4e-4e7f-b03e-eefca4c902bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1240 microversion: 2.1 time: 0.165125 Oct 12 00:20:19.072565 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 14/24] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:18 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1240 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:19.106933 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:19.127497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f04a1162-aea8-48d8-8546-abda2e261bdd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1217 microversion: 2.1 time: 0.386631 Oct 12 00:20:19.129417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 11/25] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:18 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1217 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:19.493722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:19.499141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:19.526423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:19.527810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:19.529816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:19.541754 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:19.544610 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:19.546009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:19.732983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:19.742638 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0758626d-fc92-47a0-a51f-a6852baad586 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1241 microversion: 2.1 time: 0.264380 Oct 12 00:20:19.743620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 15/26] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:19 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1241 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:19.884832 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:19.885457 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:19.896572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:19.897524 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:19.898951 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:19.901628 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:19.903004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:19.903611 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:20.055858 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:20.070047 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4a9263ee-e098-421c-81b6-ecb7068dcf70 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:20.070932 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4a9263ee-e098-421c-81b6-ecb7068dcf70 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:20.085549 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c2cd7aa8-d878-4882-9fd9-6ba2e94e93b6 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1211 microversion: 2.1 time: 0.205215 Oct 12 00:20:20.088459 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 12/27] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:19 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1211 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:20.152688 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:20.153311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:20.177037 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:20.177037 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:20.182098 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:20.184168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:20.187064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:20.187531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:20.243995 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4a9263ee-e098-421c-81b6-ecb7068dcf70 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:20.252537 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4a9263ee-e098-421c-81b6-ecb7068dcf70 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1240 microversion: 2.1 time: 0.186428 Oct 12 00:20:20.257178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 16/28] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:20 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1240 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:20.331913 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:20.351573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dff0db7b-e2f2-4e87-8aa5-647cffcb682a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1273 microversion: 2.1 time: 0.194889 Oct 12 00:20:20.351573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 13/29] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:20 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1273 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:20.769636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:20.769636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:20.775752 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:20.776470 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:20.777085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:20.777939 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:20.778402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:20.778831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:20.909472 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:20.927109 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b60f8733-921c-45c6-8f4d-8d32a30d23f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1233 microversion: 2.1 time: 0.164391 Oct 12 00:20:20.934252 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:20 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1233 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:21.146786 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:21.149203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:21.167466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:21.170462 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:21.173260 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:21.178128 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:21.178823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:21.180309 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:21.288715 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:21.289607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:21.303733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:21.306614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:21.307381 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:21.310315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:21.312148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:21.313075 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:21.502124 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:21.515783 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0c405b22-eae5-41c7-a481-537438a96b14 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1267 microversion: 2.1 time: 0.378251 Oct 12 00:20:21.517894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 14/31] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:21 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1267 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:21.535325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:21.561144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:21.574614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-18f0ef1c-2b24-40ff-9f36-2f36bc77e992 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1236 microversion: 2.1 time: 0.296270 Oct 12 00:20:21.577031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 18/32] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:21 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1236 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:21.585343 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:21.612403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:21.613027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:21.613478 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:21.614213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:21.614669 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:21.618790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:21.738684 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:21.750924 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0313827e-926d-4fce-9e6a-e0bc3cc52676 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1279 microversion: 2.1 time: 0.231474 Oct 12 00:20:21.751979 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 15/33] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:21 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:21.963452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:21.964267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:22.012136 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:22.013152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:22.014564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:22.019223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:22.021190 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:22.026396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:22.545540 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:22.548464 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:22.571765 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:22.574903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:22.576817 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:22.579199 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:22.581176 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:22.581824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:22.907292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:22.932235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9406aac9-ab4c-401b-ac28-1c3e8ada53ef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1233 microversion: 2.1 time: 0.958441 Oct 12 00:20:22.932885 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 19/34] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:21 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1233 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:22.962889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:22.965638 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:22.981127 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:22.988581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:22.990216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:22.993205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:22.995514 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:23.001288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:23.057170 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:23.066536 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8c48d835-401a-40f4-8a5c-122c5d389047 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1275 microversion: 2.1 time: 0.528334 Oct 12 00:20:23.089026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 16/35] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:22 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1275 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:23.102483 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:23.103429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:23.142088 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:23.142584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:23.145492 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:23.149503 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:23.150313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:23.150909 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:23.186307 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:23.204295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d519f377-9d03-414c-ae77-65e38c6ede3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1236 microversion: 2.1 time: 0.248016 Oct 12 00:20:23.215644 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 20/36] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:22 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1236 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:23.395707 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:23.408093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c8646866-8acc-4c20-8694-9c666d3cbfab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1279 microversion: 2.1 time: 0.316176 Oct 12 00:20:23.409140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 17/37] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:23 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1279 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:23.960674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:23.961218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:23.968043 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:23.968690 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:23.968947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:23.969836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:23.970515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:23.971088 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:24.097881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:24.100902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:24.131887 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:24.132411 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:24.132916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:24.153361 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:24.155885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:24.156335 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:24.395417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:24.436281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7a85195c-7090-454c-87a4-6dcf2aedc522 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1273 microversion: 2.1 time: 0.342841 Oct 12 00:20:24.438793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 18/38] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:24 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1273 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:24.468332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:24.469640 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:24.502395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:24.503564 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:24.504829 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:24.507679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:24.533976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:24.533976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:24.658981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:24.676542 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-14357723-3a10-4ea9-b6f5-355fa80fca13 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1289 microversion: 2.1 time: 0.719864 Oct 12 00:20:24.679158 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 21/39] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:23 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1289 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:24.691584 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:24.692720 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:24.701342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:24.702189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:24.703041 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:24.704363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:24.710783 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:24.710783 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:25.066657 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:25.083341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-693c58ad-5b43-42ff-ac90-64c49ec58143 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.393737 Oct 12 00:20:25.084211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 22/40] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:24 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:25.243270 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:25.265956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b1f1d7cb-a4a5-4d72-9357-edc41b7438d5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1292 microversion: 2.1 time: 0.818592 Oct 12 00:20:25.272908 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 19/41] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:24 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1292 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:25.463869 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:25.472782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:25.472782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:25.472782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:25.479675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:25.480293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:25.481090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:25.481570 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:25.482028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:25.648705 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:25.684340 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-14d533fa-7788-4d16-a6c6-813bded7295b tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1273 microversion: 2.1 time: 0.225483 Oct 12 00:20:25.686038 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:25 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:25.704650 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:25.705265 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:25.723557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:25.724436 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:25.725095 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:25.726233 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:25.727016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:25.727699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:25.896819 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:25.921656 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-16706117-d8ff-48d0-9fdf-8daa17e4b71c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1295 microversion: 2.1 time: 0.220529 Oct 12 00:20:25.928497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 20/43] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:25 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1295 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:26.116084 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:26.117368 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:26.132406 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:26.136193 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:26.136735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:26.139641 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:26.140809 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:26.141296 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:26.290540 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:26.291149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:26.300732 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:26.302038 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:26.304130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:26.305047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:26.305991 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:26.313017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:26.452477 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:26.473784 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1a834dd6-2eff-4231-8402-89ab9636861a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1310 microversion: 2.1 time: 0.187050 Oct 12 00:20:26.477261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 21/44] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:26 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1310 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:26.705114 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=4 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:26.710953 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:26.711880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:26.726273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:26.726273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:26.727306 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:26.728265 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:26.728908 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:26.729746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:27.585411 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:27.596555 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-85d44490-f96d-42c6-9466-1e0beb0a04f3 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.889539 Oct 12 00:20:27.613877 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 22/45] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:26 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:27.630613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:27.631490 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:27.642796 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:27.643572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:27.644223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:27.645078 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:27.646114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:27.646894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:27.765674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:27.812884 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c821faff-4d5c-4de8-ab4a-e24548d564e4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 1.703178 Oct 12 00:20:27.817746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:27.837019 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 24/46] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:26 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 1728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:27.864798 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f0ce9e61-ab29-4d91-b130-9a2b35b1e31d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1295 microversion: 2.1 time: 0.250538 Oct 12 00:20:27.865474 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 23/47] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:27 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1295 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:27.881199 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:27.889451 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:27.914028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:27.914516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:27.914958 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:27.928687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:27.929173 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:27.929610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:28.261476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-8f26b457-e476-40fb-bd26-a914973df031 req-6dcf5147-af94-4627-8126-ecaf54a0ba67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9bf92f4-feae-4c05-afff-d0daff3371e3", "tag": "c00ed7a3-6f70-42f2-91d7-bc8ef378b584"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:28.288431 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-8f26b457-e476-40fb-bd26-a914973df031 req-6dcf5147-af94-4627-8126-ecaf54a0ba67 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:28.291790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-8f26b457-e476-40fb-bd26-a914973df031 req-6dcf5147-af94-4627-8126-ecaf54a0ba67 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:28.292260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-8f26b457-e476-40fb-bd26-a914973df031 req-6dcf5147-af94-4627-8126-ecaf54a0ba67 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:28.342020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-8f26b457-e476-40fb-bd26-a914973df031 req-6dcf5147-af94-4627-8126-ecaf54a0ba67 service nova] Creating event network-changed:c00ed7a3-6f70-42f2-91d7-bc8ef378b584 for instance f9bf92f4-feae-4c05-afff-d0daff3371e3 on hv-cinder-84914 Oct 12 00:20:28.348097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-8f26b457-e476-40fb-bd26-a914973df031 req-6dcf5147-af94-4627-8126-ecaf54a0ba67 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 00:20:28.348685 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-8f26b457-e476-40fb-bd26-a914973df031 req-6dcf5147-af94-4627-8126-ecaf54a0ba67 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 00:20:28.350046 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:28.350506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:28.351355 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:28.352100 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:28.352547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:28.352955 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:28.372043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:28.374493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.compute.rpcapi [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 00:20:28.380831 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bfea79be-4941-408c-946b-49db2432950b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1298 microversion: 2.1 time: 0.508099 Oct 12 00:20:28.381901 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 24/48] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:27 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1298 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:28.382431 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] Releasing lock "compute-rpcapi-router" {{(pid=125809) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 00:20:28.409680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-29f292e7-1dc3-4c6a-bb3d-3c3db2017243 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.570651 Oct 12 00:20:28.410756 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 25/49] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:28.624503 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:28.625447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:28.629930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:28.634159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=24 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:28.643196 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:28.644110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:28.645023 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:28.648932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:28.650349 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:28.657070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:28.843044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:28.844074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:28.858072 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:28.858566 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:28.859017 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:28.859738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:28.860346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:28.860913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:29.352452 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:29.359567 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:29.364428 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-62c81719-1e9e-4ade-930c-ecbc043b9c01 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.747265 Oct 12 00:20:29.365008 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 25/50] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:28 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:29.383267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:29.385214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:29.388087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b0b1a938-f7bf-454e-a852-3634a9b3e57e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.549638 Oct 12 00:20:29.395196 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:29.397595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:29.398353 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:29.401390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 26/51] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:28 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:29.402597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:29.409480 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:29.412547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:29.413369 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:29.415685 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:29.421155 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:29.421833 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:29.424354 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:29.424354 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:29.424354 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:29.424354 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:29.476508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:29.597867 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:29.610948 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-44b8d8a4-8016-432c-a328-8ec338ee35e4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1298 microversion: 2.1 time: 0.203728 Oct 12 00:20:29.613171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 27/52] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:29 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1298 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:29.746805 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-2f5c0608-863a-4276-869e-e2300d999383 req-9f5453a1-724a-442e-8560-b942a7c55263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20228600-f497-4d8c-86c7-1ba7f1a986e0", "tag": "5ebb0516-e416-4555-8242-08922710f750"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:29.768647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2f5c0608-863a-4276-869e-e2300d999383 req-9f5453a1-724a-442e-8560-b942a7c55263 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:29.769920 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2f5c0608-863a-4276-869e-e2300d999383 req-9f5453a1-724a-442e-8560-b942a7c55263 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:29.775801 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2f5c0608-863a-4276-869e-e2300d999383 req-9f5453a1-724a-442e-8560-b942a7c55263 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:29.794375 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-2f5c0608-863a-4276-869e-e2300d999383 req-9f5453a1-724a-442e-8560-b942a7c55263 service nova] Creating event network-changed:5ebb0516-e416-4555-8242-08922710f750 for instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 on hv-cinder-84914 Oct 12 00:20:29.811507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-2f5c0608-863a-4276-869e-e2300d999383 req-9f5453a1-724a-442e-8560-b942a7c55263 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196842 Oct 12 00:20:29.812209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 28/53] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:29.877899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:29.903554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a9d93bfc-e4a8-4a58-9d0e-a51b59429345 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.536661 Oct 12 00:20:29.907237 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 26/54] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:29 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:30.391000 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=32 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:30.397837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:30.402974 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:30.413078 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:30.413326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:30.413933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:30.414146 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:30.415895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:30.422121 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:30.422121 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:30.422121 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:30.426672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:30.427166 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:30.432004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:30.452988 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:30.453858 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:30.454344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:31.174765 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:31.187044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ef114acd-f6e4-4d9c-b172-a39c83eae28c tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.796744 Oct 12 00:20:31.206596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:31.208609 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 29/55] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:30 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:31.215476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-998f421a-21ef-4725-8d1c-d175d8766ef3 req-1b2f804e-921d-410d-8c4e-b812cf66df44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25e6edd-85e7-464f-b41c-3f2ed44ad585", "tag": "1d1bac53-3ee0-4790-9953-56840696e26d"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:31.232152 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-25a60838-2356-49e0-931c-837bc0f035b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.822636 Oct 12 00:20:31.236045 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-998f421a-21ef-4725-8d1c-d175d8766ef3 req-1b2f804e-921d-410d-8c4e-b812cf66df44 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:31.236735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-998f421a-21ef-4725-8d1c-d175d8766ef3 req-1b2f804e-921d-410d-8c4e-b812cf66df44 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:31.237802 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-998f421a-21ef-4725-8d1c-d175d8766ef3 req-1b2f804e-921d-410d-8c4e-b812cf66df44 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:31.246258 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 27/56] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:30 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:31.260700 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:31.262000 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:31.265327 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-998f421a-21ef-4725-8d1c-d175d8766ef3 req-1b2f804e-921d-410d-8c4e-b812cf66df44 service nova] Creating event network-changed:1d1bac53-3ee0-4790-9953-56840696e26d for instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 on hv-cinder-84914 Oct 12 00:20:31.274366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-998f421a-21ef-4725-8d1c-d175d8766ef3 req-1b2f804e-921d-410d-8c4e-b812cf66df44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064248 Oct 12 00:20:31.276037 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 30/57] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:31.280255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:31.281129 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:31.282565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:31.284980 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:31.286147 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:31.287429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:31.288505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:31.289618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:31.300050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:31.300772 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:31.304085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:31.304085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:31.304085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:31.304085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:31.547525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:31.556931 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ce41816b-5016-40d6-98b9-7de65c520377 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.279421 Oct 12 00:20:31.558270 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 31/58] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:31 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:32.234215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:32.234215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:32.271895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:32.276037 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:32.277636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:32.281074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:32.283350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:32.284077 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:32.371913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=100 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:32.652997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:32.679442 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9f5e459d-4984-4d59-9b62-bc7c5c889fc1 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.470527 Oct 12 00:20:32.680534 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 32/59] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:32 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:32.706375 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:32.716582 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:32.717947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:32.730908 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9073d67f-7e3f-44c1-8d78-db94f9bb5a53 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 1.482030 Oct 12 00:20:32.731514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 28/60] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:31 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:32.739021 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-ea3f53da-5de8-42e4-961a-3e3b6ce23662 req-d598c9d6-5850-4d13-bcb8-ddd990e45cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a130e92-2fae-45a7-a64c-bffbf46b4758", "tag": "2d8c0a54-e70d-4bc8-9356-dab7272389bd"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:32.741245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:32.741787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:32.742252 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:32.746830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:32.746830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:32.746830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:32.796713 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:32.798719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ea3f53da-5de8-42e4-961a-3e3b6ce23662 req-d598c9d6-5850-4d13-bcb8-ddd990e45cc4 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:32.803003 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ea3f53da-5de8-42e4-961a-3e3b6ce23662 req-d598c9d6-5850-4d13-bcb8-ddd990e45cc4 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:32.803531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ea3f53da-5de8-42e4-961a-3e3b6ce23662 req-d598c9d6-5850-4d13-bcb8-ddd990e45cc4 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:32.877794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-ea3f53da-5de8-42e4-961a-3e3b6ce23662 req-d598c9d6-5850-4d13-bcb8-ddd990e45cc4 service nova] Creating event network-changed:2d8c0a54-e70d-4bc8-9356-dab7272389bd for instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 on hv-cinder-84914 Oct 12 00:20:32.878314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ea3f53da-5de8-42e4-961a-3e3b6ce23662 req-d598c9d6-5850-4d13-bcb8-ddd990e45cc4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 00:20:32.878710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ea3f53da-5de8-42e4-961a-3e3b6ce23662 req-d598c9d6-5850-4d13-bcb8-ddd990e45cc4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 00:20:32.880070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:32.880479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:32.880975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:32.881854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:32.885414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:32.890932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:32.920877 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.compute.rpcapi [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 00:20:32.928930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] Releasing lock "compute-rpcapi-router" {{(pid=125810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 00:20:32.985768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-08e6c962-a518-4dd0-a477-f5a35cab5de6 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251855 Oct 12 00:20:32.986973 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 29/61] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:32.996194 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:32.999950 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:33.011698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:33.023425 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:33.023425 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:33.023425 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:33.023425 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:33.023762 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:33.450088 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:33.460437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c7b6fb45-d0e3-481a-a4cd-39e937a3ea3a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.778127 Oct 12 00:20:33.479953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 33/62] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:32 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:33.631350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:33.642494 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b7b270eb-2c8c-4476-8e2f-4e3e636e7c21 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.654067 Oct 12 00:20:33.666540 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 30/63] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:32 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:33.720735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:33.721240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:33.747925 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:33.748815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:33.749394 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:33.750460 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:33.751213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:33.753275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:33.759755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:33.760400 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:33.773731 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:33.774527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:33.776441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:33.779158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:33.780667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:33.781267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:34.043050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:34.052382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-02bfeeed-50ce-4c75-bb6c-de9482c9133a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.296929 Oct 12 00:20:34.053630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 31/64] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:33 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:34.131460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-2685e1ca-3eda-4102-b0d4-15f7b21f0cbf req-2874602c-a169-4271-90cc-21833e325d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d5f38e-5fbf-4a54-adf9-6025f1358776", "tag": "25ead2ef-e264-4674-985a-3ce94c8b6181"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:34.149285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2685e1ca-3eda-4102-b0d4-15f7b21f0cbf req-2874602c-a169-4271-90cc-21833e325d82 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:34.158204 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2685e1ca-3eda-4102-b0d4-15f7b21f0cbf req-2874602c-a169-4271-90cc-21833e325d82 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:34.158204 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2685e1ca-3eda-4102-b0d4-15f7b21f0cbf req-2874602c-a169-4271-90cc-21833e325d82 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:34.233378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-2685e1ca-3eda-4102-b0d4-15f7b21f0cbf req-2874602c-a169-4271-90cc-21833e325d82 service nova] Creating event network-changed:25ead2ef-e264-4674-985a-3ce94c8b6181 for instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 on hv-cinder-84914 Oct 12 00:20:34.248546 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-2685e1ca-3eda-4102-b0d4-15f7b21f0cbf req-2874602c-a169-4271-90cc-21833e325d82 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120752 Oct 12 00:20:34.249988 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 32/65] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:20:34.414812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:34.423619 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-df61ec33-8654-40f1-9bfd-0b945ce937dc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.715335 Oct 12 00:20:34.429696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 34/66] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:33 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:34.492202 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:34.493036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:34.503637 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:34.504302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:34.518329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:34.519525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:34.519956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:34.520424 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:34.680167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:34.681773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:34.702889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:34.705126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:34.706122 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:34.707152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:34.709840 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:34.711459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:35.038398 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:35.056028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7f15020c-47a4-4bc6-813c-66acf37dd9f2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.572551 Oct 12 00:20:35.057294 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 33/67] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:34 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:35.079158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:35.079970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:35.098393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:35.099305 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:35.100396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:35.101595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:35.104279 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:35.104947 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:35.353608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:35.368277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-17c44a15-f27f-4c61-b910-75d2ec6640a1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.292915 Oct 12 00:20:35.370041 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 34/68] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:35 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:35.418447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:35.428139 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2373f46a-1fa8-4764-841d-14c2c6bcdbc0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.757413 Oct 12 00:20:35.429148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 35/69] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:34 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:35.453715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:35.454326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:35.460341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:35.460815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:35.461241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:35.461927 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:35.462523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:35.463016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:35.606111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:35.614097 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5a7cffe2-955d-4746-bece-b8bf53725f39 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.165652 Oct 12 00:20:35.615791 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 35/70] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:35 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:36.085718 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:36.086617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:36.094336 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:36.094983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:36.095821 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:36.096666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:36.097752 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:36.098503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:36.232502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:36.241405 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b4eba483-c064-4cd2-ae09-d5be049533ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.160654 Oct 12 00:20:36.243790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 36/71] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:36 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:36.392545 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:36.393929 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:36.399952 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:36.400428 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:36.400855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:36.401542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:36.401993 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:36.402402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:36.453170 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:36.455468 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:36.462962 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:36.463561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:36.464237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:36.465143 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:36.468446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:36.469096 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:36.571467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:36.577027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-45e9391b-365d-473b-987a-74ce7db058cc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.188924 Oct 12 00:20:36.577880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 36/72] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:36 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:36.629782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:36.639124 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:36.639315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d50afd5c-50d6-4a61-9269-c4dc382b458f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.192053 Oct 12 00:20:36.640070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:36.646230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:36.646720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:36.647151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:36.647894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:36.648336 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:36.648972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:36.659757 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 37/73] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:36 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:36.972662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:36.981157 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d9cd9c5c-c28a-488a-9d49-3cc8f7591c9d tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.346519 Oct 12 00:20:36.995399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 37/74] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:36 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:37.264084 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:37.265028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:37.271425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:37.271996 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:37.272505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:37.273311 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:37.273841 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:37.274338 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:37.417298 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:37.425388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c0ebeacd-ab10-44b5-a372-cc90513e0b88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.165389 Oct 12 00:20:37.440131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 38/75] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:37 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:37.600411 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:37.601026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:37.607942 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:37.608419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:37.608839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:37.609697 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:37.610143 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:37.610557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:37.671994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:37.673538 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:37.679329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:37.679874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:37.680371 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:37.681082 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:37.681534 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:37.681962 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:37.772667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:37.787769 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b872cb50-675a-4c5d-b105-7486e59d43b9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.185617 Oct 12 00:20:37.787769 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 38/76] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:37 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:37.871801 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:37.880003 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4460fb6a-b059-483d-bff5-fb6d04b3d769 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.213707 Oct 12 00:20:37.894104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 39/77] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:37 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:38.007025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:38.008616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:38.016573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:38.017057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:38.017487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:38.018181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:38.018627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:38.019048 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:38.152736 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:38.161000 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-451286b4-3448-4506-bd89-152d90b951df tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.160038 Oct 12 00:20:38.161608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 39/78] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:37 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:38.450160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:38.451036 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:38.452975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:38.457678 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:38.458162 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:38.458590 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:38.459453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:38.460018 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:38.460303 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:38.611840 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:38.619472 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-400970c4-b9f0-43ce-8197-3b19aff1e2b5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.173200 Oct 12 00:20:38.620402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 40/79] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:38 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:38.805970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:38.806572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:38.812812 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:38.813291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:38.813744 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:38.814433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:38.814874 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:38.815289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:38.914573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:38.916262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:38.931253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:38.931947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:38.932656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:38.933329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:38.933783 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:38.934205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:38.989577 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:38.997384 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-87455f36-03db-45e3-ac8e-e129006dc2ba tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.195245 Oct 12 00:20:38.997959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 40/80] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:38 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:39.099306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:39.109044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f6715c97-deb5-403d-a611-7097b9cf819d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.208653 Oct 12 00:20:39.110313 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 41/81] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:38 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:39.185428 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:39.186387 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:39.193290 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:39.193951 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:39.194589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:39.195478 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:39.196330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:39.196765 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:39.453307 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:39.462729 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0b3baa56-86eb-4d18-a68a-4164101a8210 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.282304 Oct 12 00:20:39.464071 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:39 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:39.642327 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:39.642932 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:39.648902 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:39.649386 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:39.649816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:39.650721 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:39.651173 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:39.651621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:39.814204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:39.829353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9f3c7d09-bd5e-407e-85f6-865e3fc7fe05 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.184138 Oct 12 00:20:39.830303 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 42/83] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:39 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:40.024700 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:40.025463 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:40.034466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:40.034466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:40.034466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:40.034466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:40.034786 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:40.034786 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:40.134000 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:40.134619 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:40.157965 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:40.181617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:40.181617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:40.181617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:40.181617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:40.182347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:40.274539 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:40.281372 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2d9a16aa-6710-4978-a96d-76c661d5739a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.260428 Oct 12 00:20:40.282085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 42/84] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:40 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:40.490165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:40.491500 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3340fa5e-0885-49bd-a2e4-6529beac6ec4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.362882 Oct 12 00:20:40.493626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 43/85] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:40 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:40.494508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:40.495130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:40.517724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:40.518518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:40.519146 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:40.520310 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:40.521021 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:40.522156 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:40.679724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:40.688976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cb2dbc77-e50c-482e-a13d-03e63b8fa690 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.199127 Oct 12 00:20:40.689826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 43/86] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:40 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:40.853226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:40.853834 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:40.859789 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:40.860296 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:40.860733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:40.861418 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:40.861869 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:40.862293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:40.992064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:41.000390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a9c5a118-538d-4f43-be8e-45f42951cae9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.151110 Oct 12 00:20:41.000961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 44/87] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:40 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:41.306021 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:41.306698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:41.316392 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:41.316885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:41.318757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:41.318967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:41.319458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:41.319894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:41.348017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:41.500240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:41.510173 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e5b69351-2e4e-49c1-966b-1db726b8365c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.207960 Oct 12 00:20:41.510776 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 44/88] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:41 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:41.527924 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:41.530001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:41.535388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:41.536360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:41.536798 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:41.537505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:41.537951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:41.538370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:41.718327 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:41.721253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:41.736552 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:41.747558 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:41.748632 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:41.748926 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-fed49d1d-c8ab-4130-9c4d-4880c168987f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.222214 Oct 12 00:20:41.750093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:41.764924 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 45/89] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:41 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:41.766122 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:41.766753 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:41.769721 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:41.936675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:41.944642 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-95e723dd-cec4-473e-b6df-d788ec0a77a8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.235810 Oct 12 00:20:41.945521 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 45/90] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:41 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:42.025370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:42.026459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:42.052258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.052948 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.053552 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:42.054700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.055293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.055976 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:42.228981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:42.236985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7f586c2b-fc3a-481b-9cee-d30048eb65dc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.216885 Oct 12 00:20:42.237932 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 46/91] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:42 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:42.533718 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:42.534321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:42.540290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.540769 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.541200 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:42.541892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.542508 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.543073 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:42.571162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-29a3aab8-4cce-422f-8982-abc0590346e6 req-6d924c84-f683-4850-a241-b65a2e177457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25e6edd-85e7-464f-b41c-3f2ed44ad585", "name": "network-vif-plugged", "status": "completed", "tag": "1d1bac53-3ee0-4790-9953-56840696e26d"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:42.581614 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-29a3aab8-4cce-422f-8982-abc0590346e6 req-6d924c84-f683-4850-a241-b65a2e177457 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.582239 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-29a3aab8-4cce-422f-8982-abc0590346e6 req-6d924c84-f683-4850-a241-b65a2e177457 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.582970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-29a3aab8-4cce-422f-8982-abc0590346e6 req-6d924c84-f683-4850-a241-b65a2e177457 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:42.600439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-29a3aab8-4cce-422f-8982-abc0590346e6 req-6d924c84-f683-4850-a241-b65a2e177457 service nova] Creating event network-vif-plugged:1d1bac53-3ee0-4790-9953-56840696e26d for instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 on hv-cinder-84914 Oct 12 00:20:42.611693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-29a3aab8-4cce-422f-8982-abc0590346e6 req-6d924c84-f683-4850-a241-b65a2e177457 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195488 Oct 12 00:20:42.613298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 46/92] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:42.713234 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:42.721381 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0d52cf45-afce-4ad9-99f2-4de15bbf4d88 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.191326 Oct 12 00:20:42.729461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 47/93] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:42 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:42.779527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:42.780665 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:42.788715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.789195 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.789623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:42.790317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.790930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.791710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:42.906042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:42.930607 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:42.941200 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-407089b7-7cdf-43b5-8e4a-6368dc083803 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.167633 Oct 12 00:20:42.941881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 47/94] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:42 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:42.968725 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:42.969506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:42.975798 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.983261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.983756 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:42.984473 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:42.984927 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:42.985643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:43.260825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:43.261524 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:43.281192 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:43.283430 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:43.284761 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:43.286279 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:43.288563 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:43.289648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:43.446263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:43.458125 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5fe7b3cc-6af6-43cd-bbed-643e7329edba tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.490769 Oct 12 00:20:43.462096 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 48/95] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:42 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:43.496196 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:43.505188 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dfae58fb-8d50-4444-a7f4-ffc56fa18bcf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.248499 Oct 12 00:20:43.505839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 48/96] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:43 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:43.745750 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:43.746424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:43.752814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:43.753287 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:43.753713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:43.754389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:43.754832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:43.755246 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:43.759199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=100 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:43.895178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:43.903254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-32b1926c-8758-49c5-bbff-a59cd8f37de7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.161449 Oct 12 00:20:43.903858 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 49/97] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:43 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:43.966340 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:43.967051 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:43.973255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:43.973842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:43.974329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:43.975917 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:43.975917 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:43.976476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:44.125683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:44.144194 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1c5487a7-a30b-422b-9ff5-d836ad79981a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.181901 Oct 12 00:20:44.144624 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 49/98] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:43 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:44.484752 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:44.485437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:44.491808 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:44.492295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:44.492729 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:44.493423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:44.494110 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:44.494538 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:44.535512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:44.535512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:44.538021 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:44.538521 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:44.538975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:44.539896 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:44.540375 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:44.540802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:44.669529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:44.677767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ad728b26-bfb5-4230-9cbd-54b29e808993 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.196622 Oct 12 00:20:44.692478 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 50/99] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:44 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:44.726874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-d8a1c848-ba54-431c-a843-7b493245dd42 req-0d065263-0ccf-42a0-a8ce-6f20ec8b2b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20228600-f497-4d8c-86c7-1ba7f1a986e0", "name": "network-vif-plugged", "status": "completed", "tag": "5ebb0516-e416-4555-8242-08922710f750"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:44.731097 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:44.744234 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1fa8adb4-a342-46fe-9cab-e1357a652eda tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.218738 Oct 12 00:20:44.746303 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-d8a1c848-ba54-431c-a843-7b493245dd42 req-0d065263-0ccf-42a0-a8ce-6f20ec8b2b53 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:44.751894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 50/100] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:44 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:44.752010 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-d8a1c848-ba54-431c-a843-7b493245dd42 req-0d065263-0ccf-42a0-a8ce-6f20ec8b2b53 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:44.752010 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-d8a1c848-ba54-431c-a843-7b493245dd42 req-0d065263-0ccf-42a0-a8ce-6f20ec8b2b53 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:44.777516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-d8a1c848-ba54-431c-a843-7b493245dd42 req-0d065263-0ccf-42a0-a8ce-6f20ec8b2b53 service nova] Creating event network-vif-plugged:5ebb0516-e416-4555-8242-08922710f750 for instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 on hv-cinder-84914 Oct 12 00:20:44.783570 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-d8a1c848-ba54-431c-a843-7b493245dd42 req-0d065263-0ccf-42a0-a8ce-6f20ec8b2b53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072592 Oct 12 00:20:44.784448 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 51/101] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:44.925959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:44.926771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:44.932756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:44.933238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:44.933659 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:44.934378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:44.934823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:44.935239 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:45.069952 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:45.098427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5e0e3e36-fd40-475c-98df-a805f6d75c65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.176318 Oct 12 00:20:45.101019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 51/102] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:44 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:45.167761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:45.168216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:45.178757 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:45.179218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:45.179801 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:45.180513 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:45.182602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:45.183064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:45.389962 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:45.398639 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-91938c9c-f6d4-427a-8619-671e8808df60 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.236288 Oct 12 00:20:45.399297 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 52/103] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:45 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:45.700481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:45.701098 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:45.717293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:45.717293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:45.717293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:45.717293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:45.717594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:45.717594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:45.769089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:45.769846 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:45.776010 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:45.776572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:45.777101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:45.777820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:45.778265 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:45.778680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:45.847590 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:45.856742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a216827f-8934-4e8a-8d77-af4638b72f5e tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1315 microversion: 2.1 time: 0.159691 Oct 12 00:20:45.861952 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 52/104] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:45 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:45.930076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:45.939016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2f528106-835f-4c51-997b-41fdcfe8ed92 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.173746 Oct 12 00:20:45.939628 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 53/105] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:45 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:46.124112 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:46.125082 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:46.131842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.132402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.133129 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:46.133954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.134557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.134990 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:46.333667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:46.357312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e534dedd-5d96-4ff7-8240-47ad41d07b19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.236552 Oct 12 00:20:46.357312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 53/106] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:46 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:46.422076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:46.422814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:46.428969 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.429446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.429871 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:46.430698 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.431318 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.431936 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:46.663494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:46.672403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-60ba1dd2-4af8-4b75-b98b-296207b6ddfd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.255086 Oct 12 00:20:46.675345 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 54/107] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:46 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:46.803458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-6678ed38-31f9-4c6f-9d2e-869a54df5654 req-cb6241be-420d-43f7-a2b5-ee3d152bd69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a130e92-2fae-45a7-a64c-bffbf46b4758", "name": "network-vif-plugged", "status": "completed", "tag": "2d8c0a54-e70d-4bc8-9356-dab7272389bd"}, {"server_uuid": "f9bf92f4-feae-4c05-afff-d0daff3371e3", "name": "network-vif-plugged", "status": "completed", "tag": "c00ed7a3-6f70-42f2-91d7-bc8ef378b584"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:46.819016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6678ed38-31f9-4c6f-9d2e-869a54df5654 req-cb6241be-420d-43f7-a2b5-ee3d152bd69e service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.819016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6678ed38-31f9-4c6f-9d2e-869a54df5654 req-cb6241be-420d-43f7-a2b5-ee3d152bd69e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.819016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6678ed38-31f9-4c6f-9d2e-869a54df5654 req-cb6241be-420d-43f7-a2b5-ee3d152bd69e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:46.831117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-6678ed38-31f9-4c6f-9d2e-869a54df5654 req-cb6241be-420d-43f7-a2b5-ee3d152bd69e service nova] Creating event network-vif-plugged:2d8c0a54-e70d-4bc8-9356-dab7272389bd for instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 on hv-cinder-84914 Oct 12 00:20:46.831742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-6678ed38-31f9-4c6f-9d2e-869a54df5654 req-cb6241be-420d-43f7-a2b5-ee3d152bd69e service nova] Creating event network-vif-plugged:c00ed7a3-6f70-42f2-91d7-bc8ef378b584 for instance f9bf92f4-feae-4c05-afff-d0daff3371e3 on hv-cinder-84914 Oct 12 00:20:46.838644 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-6678ed38-31f9-4c6f-9d2e-869a54df5654 req-cb6241be-420d-43f7-a2b5-ee3d152bd69e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038755 Oct 12 00:20:46.839479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 54/108] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:46.879683 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:46.880917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:46.886992 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.889235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.889235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:46.890157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.890781 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.892707 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:46.966157 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:46.967418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:46.978466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.979989 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.980427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:46.981688 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:46.982134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:46.982555 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:47.058276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:47.066540 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f64df9a7-6da8-47c1-a83e-fcbf98e003ef tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1501 microversion: 2.1 time: 0.190677 Oct 12 00:20:47.067126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 55/109] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:46 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:47.144552 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:47.153679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-923f96ee-b90c-475c-9a07-28ecd9835e60 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1321 microversion: 2.1 time: 0.194254 Oct 12 00:20:47.167444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 55/110] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:46 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:47.387292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:47.388032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:47.411178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:47.414911 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:47.415396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:47.416112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:47.416566 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:47.416982 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:47.635739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:47.650960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f533d7cf-5cfb-4d9b-930c-6f2dcd874c2d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.270941 Oct 12 00:20:47.650960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 56/111] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:47 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:47.698486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:47.699436 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:47.706088 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:47.706746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:47.707213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:47.707940 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:47.708389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:47.708973 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:47.955893 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:47.969505 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9aaa054a-1907-4f64-9ed9-100889c3044a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.274964 Oct 12 00:20:47.970200 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 56/112] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:47 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:48.177349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:48.177958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:48.184479 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.184951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.185378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.186096 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.188014 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.192378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.375984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:48.382987 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d81750db-344f-4224-b7b8-ea40182aba0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1515 microversion: 2.1 time: 0.209493 Oct 12 00:20:48.384973 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 57/113] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:48 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:48.426410 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:48.428913 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:48.436241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.440619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.440619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.440619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.440619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.440965 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.545579 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lazy-loading 'flavor' on Instance uuid 20228600-f497-4d8c-86c7-1ba7f1a986e0 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:20:48.669236 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:48.670065 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:48.676442 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.677113 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.677536 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.678429 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.679019 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.679660 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.831709 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:48.839535 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8cfe58f8-5c30-4868-a93d-9d2d3b7f3427 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.174747 Oct 12 00:20:48.842444 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 58/114] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:48 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:48.857853 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-e23f2028-2904-4428-92ed-83d17f3fcedd req-8fb0954d-f000-4a35-a9c0-e5160d0072d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d5f38e-5fbf-4a54-adf9-6025f1358776", "name": "network-vif-plugged", "status": "completed", "tag": "25ead2ef-e264-4674-985a-3ce94c8b6181"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:48.878925 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e23f2028-2904-4428-92ed-83d17f3fcedd req-8fb0954d-f000-4a35-a9c0-e5160d0072d0 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.878925 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e23f2028-2904-4428-92ed-83d17f3fcedd req-8fb0954d-f000-4a35-a9c0-e5160d0072d0 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.878925 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e23f2028-2904-4428-92ed-83d17f3fcedd req-8fb0954d-f000-4a35-a9c0-e5160d0072d0 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.888587 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-e23f2028-2904-4428-92ed-83d17f3fcedd req-8fb0954d-f000-4a35-a9c0-e5160d0072d0 service nova] Creating event network-vif-plugged:25ead2ef-e264-4674-985a-3ce94c8b6181 for instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 on hv-cinder-84914 Oct 12 00:20:48.895778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-e23f2028-2904-4428-92ed-83d17f3fcedd req-8fb0954d-f000-4a35-a9c0-e5160d0072d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042154 Oct 12 00:20:48.896904 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 59/115] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:20:48.910957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-784649ed-a5f5-4fe1-9730-41f742ab4f1e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0/action" status: 200 len: 32 microversion: 2.1 time: 0.485072 Oct 12 00:20:48.910957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 57/116] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:20:48 2022] POST /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0/action => generated 32 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:20:48.920343 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:48.920941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:48.928615 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.929269 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.929572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.930264 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:48.930742 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:48.931154 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:48.999032 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:48.999682 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:49.008360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:49.008860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:49.009295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:49.010314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:49.010907 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:49.011347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:49.103348 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:49.112766 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f7298e29-be42-4ad5-b498-b6a6707401c7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.197616 Oct 12 00:20:49.113370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 60/117] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:48 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:49.185188 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:49.194171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4440015e-75de-4050-9e96-c60183873446 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.206358 Oct 12 00:20:49.204828 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 58/118] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:48 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:49.498060 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8534eba-23f7-49c1-b6d5-3276772fa2ac"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:49.500454 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:49.506508 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:49.506981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:49.507434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:49.508118 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:49.508566 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:49.508986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:49.874622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:49.875231 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:49.881309 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:49.881783 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:49.882214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:49.882895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:49.883341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:49.883799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:50.015977 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:50.026468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-71821c7b-4f05-4930-bcbb-61d77d27ad5e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.154419 Oct 12 00:20:50.026468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 59/119] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:49 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:50.138062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:50.139322 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:50.148167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:50.149036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:50.149689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:50.150551 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:50.151358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:50.151999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:50.156671 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:50.348699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:50.358174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4e6573d0-8939-4f81-892c-31e997599494 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.225606 Oct 12 00:20:50.358874 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 60/120] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:50 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:50.363652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:50.364311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:50.370267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:50.370825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:50.371534 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:50.372231 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:50.372687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:50.373111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:50.565395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:50.573606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ec203f3c-ddd1-4a61-9746-d93cdbae8e41 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1362 microversion: 2.1 time: 0.213646 Oct 12 00:20:50.574180 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 61/121] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:50 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:51.048419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:51.049332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:51.056142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:51.056694 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:51.057271 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:51.058105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:51.058626 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:51.059147 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:51.195298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:51.204028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5a06ae7f-a0ca-49df-9119-d07983c2d84b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.159525 Oct 12 00:20:51.204839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 62/122] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:51 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:20:51.381879 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:51.383323 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:51.392857 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:51.394117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:51.395151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:51.396179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:51.396727 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:51.397152 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:51.532652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:51.545877 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-31019af4-3306-415c-b650-9a7f3ce2c51f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.168482 Oct 12 00:20:51.560024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 63/123] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:51 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:51.596493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:51.597049 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:51.604305 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:51.608638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:51.608638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:51.608638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:51.608638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:51.609065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:51.661515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-93f8435e-d4a4-47cb-94fa-f46b05d12a58 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "POST /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.167327 Oct 12 00:20:51.663078 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 61/124] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:20:49 2022] POST /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585/os-volume_attachments => generated 194 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:51.864806 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:51.873369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cf080d80-c42e-4753-a339-427e48cb7217 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1547 microversion: 2.1 time: 0.281442 Oct 12 00:20:51.873945 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 64/125] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:51 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1547 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:51.897602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:51.898177 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:51.905013 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:51.905489 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:51.905915 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:51.906633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:51.907079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:51.907684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:51.997320 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d0835884-612e-435d-98be-8f85cafeffcb tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103839 Oct 12 00:20:51.998307 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 62/126] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Oct 12 00:20:51 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:52.226296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:52.227168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:52.233271 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:52.234944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:52.234944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:52.235272 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:52.235856 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:52.236442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:52.401227 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:52.409439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b00792f1-d4f0-4d8b-b208-7a2a9ec31b77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1365 microversion: 2.1 time: 0.187267 Oct 12 00:20:52.410011 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 65/127] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:52 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:52.570836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:52.571461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:52.578740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:52.579232 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:52.579699 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:52.586596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:52.586596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:52.586596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:52.962224 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:52.969896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f9cdf7b8-83c7-4929-a9fe-0bee18e47af2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.402978 Oct 12 00:20:52.970468 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 63/128] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:52 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:53.432811 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:53.434154 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:53.444258 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:53.448354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:53.448354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:53.448815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:53.451345 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:53.452450 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:53.660710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:53.673578 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8eff58b8-b20d-467d-b48b-141fc486482f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1555 microversion: 2.1 time: 0.245381 Oct 12 00:20:53.674821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 66/129] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:53 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:53.706380 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:53.707221 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:53.717719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-3464e1db-b1d9-4fa6-9f69-f9e9851ab0ce req-bf9a7cd0-5901-4e1c-9d90-a4fca73c8a31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a130e92-2fae-45a7-a64c-bffbf46b4758", "tag": "2d8c0a54-e70d-4bc8-9356-dab7272389bd"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:53.722737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:53.723215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:53.723679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:53.724672 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:53.725100 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:53.725519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:53.729065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3464e1db-b1d9-4fa6-9f69-f9e9851ab0ce req-bf9a7cd0-5901-4e1c-9d90-a4fca73c8a31 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:53.729715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3464e1db-b1d9-4fa6-9f69-f9e9851ab0ce req-bf9a7cd0-5901-4e1c-9d90-a4fca73c8a31 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:53.730353 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3464e1db-b1d9-4fa6-9f69-f9e9851ab0ce req-bf9a7cd0-5901-4e1c-9d90-a4fca73c8a31 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:53.743790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-3464e1db-b1d9-4fa6-9f69-f9e9851ab0ce req-bf9a7cd0-5901-4e1c-9d90-a4fca73c8a31 service nova] Creating event network-changed:2d8c0a54-e70d-4bc8-9356-dab7272389bd for instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 on hv-cinder-84914 Oct 12 00:20:53.749290 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-3464e1db-b1d9-4fa6-9f69-f9e9851ab0ce req-bf9a7cd0-5901-4e1c-9d90-a4fca73c8a31 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036161 Oct 12 00:20:53.750119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 67/130] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:20:53.862546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8d8f7388-28a5-4607-9956-053eb5eba1d4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160810 Oct 12 00:20:53.863151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 64/131] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Oct 12 00:20:53 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:53.995346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:53.996451 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:54.009813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:54.014124 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:54.014887 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:54.017522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:54.018901 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:54.021962 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:54.672651 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:54.681999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4480c8ef-1459-4edc-8ae6-f0f3103b2b5a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.691853 Oct 12 00:20:54.682693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 68/132] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:53 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:55.706879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:55.707571 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:55.714083 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:55.714792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:55.715234 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:55.715997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:55.716444 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:55.716858 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:55.837574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-de72b3be-764c-4083-b83d-95c767d958a7 req-5126bf26-6e04-4fde-9c8c-f78ced2d59ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d5f38e-5fbf-4a54-adf9-6025f1358776", "tag": "25ead2ef-e264-4674-985a-3ce94c8b6181"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:20:55.864458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-de72b3be-764c-4083-b83d-95c767d958a7 req-5126bf26-6e04-4fde-9c8c-f78ced2d59ce service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:55.865166 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-de72b3be-764c-4083-b83d-95c767d958a7 req-5126bf26-6e04-4fde-9c8c-f78ced2d59ce service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:55.865809 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-de72b3be-764c-4083-b83d-95c767d958a7 req-5126bf26-6e04-4fde-9c8c-f78ced2d59ce service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:55.890387 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-de72b3be-764c-4083-b83d-95c767d958a7 req-5126bf26-6e04-4fde-9c8c-f78ced2d59ce service nova] Creating event network-changed:25ead2ef-e264-4674-985a-3ce94c8b6181 for instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 on hv-cinder-84914 Oct 12 00:20:55.902150 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-de72b3be-764c-4083-b83d-95c767d958a7 req-5126bf26-6e04-4fde-9c8c-f78ced2d59ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068035 Oct 12 00:20:55.909584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 69/133] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:20:56.000765 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:56.010806 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-cf252997-aa9e-4e9a-842d-969faff393a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.308257 Oct 12 00:20:56.024751 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 65/134] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:55 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:57.043544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:57.045756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:57.054542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:57.055290 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:57.055942 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:57.057040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:57.057683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:57.058257 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:57.214782 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:57.222677 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a7305491-0a19-4efb-90de-6bf19dcdf9de tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.188141 Oct 12 00:20:57.223261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 70/135] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:57 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:58.244361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:58.244969 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:58.247424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=85 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:58.252086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:58.252570 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:58.254213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:58.254213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:58.254213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:58.254576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:58.298198 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:20:58.434061 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:58.448398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-fb8826fd-033f-430c-8c3d-993335939e24 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.207649 Oct 12 00:20:58.449713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 66/136] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:58 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:20:59.474745 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:20:59.475432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:20:59.482545 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:59.482989 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:59.483444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:59.484143 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:20:59.484801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:20:59.485399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:20:59.627948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:20:59.637755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e7491a41-a7a4-47cb-a6df-788cc56500a7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.168569 Oct 12 00:20:59.639571 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 71/137] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:20:59 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:00.661216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:00.661966 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:00.670003 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:00.670552 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:00.670984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:00.673947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:00.673947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:00.673947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:00.810347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:00.818335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-726d266f-8400-4082-ae2c-a9eab088c929 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.161299 Oct 12 00:21:00.818900 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 67/138] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:00 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:01.841660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:01.842783 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:01.849725 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:01.850558 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:01.851605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:01.852724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:01.853840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:01.854521 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:02.024141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:02.035194 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a7906cb3-a4fa-4dcd-9491-d80eed9c9d91 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.197451 Oct 12 00:21:02.051041 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 72/139] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:01 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:02.407908 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:02.408964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:02.418991 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:02.419733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:02.420347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:02.421204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:02.421972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:02.422545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:02.461547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:21:02.826113 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ceed9c08-29ce-4135-ba0a-466652e9e4f8 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 204 len: 0 microversion: 2.1 time: 0.422220 Oct 12 00:21:02.827104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 68/140] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:21:02 2022] DELETE /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:21:02.838199 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:02.839051 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:02.846055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:02.846625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:02.847144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:02.847982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:02.848698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:02.849336 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:03.060583 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:03.061293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:03.071453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:03.071453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:03.071453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:03.071453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:03.071789 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:03.071789 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:03.173944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:03.182309 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-96eee81f-080c-4166-8337-802989f4e259 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1553 microversion: 2.1 time: 0.350911 Oct 12 00:21:03.183675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 73/141] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:02 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1553 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:03.210586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:03.218476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bde68f19-2eed-497c-8b7f-d26ba4d7626c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.162601 Oct 12 00:21:03.219051 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 69/142] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:03 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:04.205698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:04.206843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:04.212826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:04.213302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:04.213747 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:04.215046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:04.215516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:04.215933 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:04.240544 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:04.241147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:04.247192 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:04.247691 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:04.248173 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:04.248880 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:04.249251 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:04.249664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:04.395522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:04.397428 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:04.408784 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d66b680f-5d7a-4130-8ae4-e011c64797ae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.171666 Oct 12 00:21:04.409568 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-12858a45-51a1-47bc-b752-e0c4cb243281 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1553 microversion: 2.1 time: 0.207573 Oct 12 00:21:04.409728 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 70/143] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:04 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:04.410136 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 74/144] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:04 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:05.432378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:05.432900 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:05.433263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:05.433353 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:05.435126 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=91 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:05.439717 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:05.439906 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:05.440196 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:05.440561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:05.440676 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:05.440998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:05.441296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:05.441683 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:05.441798 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:05.442158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:05.442615 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:05.443042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:05.593409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:05.602038 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7583dcdc-b7e8-45ce-950a-ec4330358557 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1553 microversion: 2.1 time: 0.173227 Oct 12 00:21:05.602610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 75/145] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:05 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:05.612865 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:05.621185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a48da209-89e6-49da-a1ac-0e9398151979 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.192837 Oct 12 00:21:05.635222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 71/146] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:05 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:06.507002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-8f3356df-405a-46ea-9427-9923f1b2c70b req-47d50277-71b7-4f15-9e3c-c948e17220b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25e6edd-85e7-464f-b41c-3f2ed44ad585", "name": "network-vif-deleted", "tag": "1d1bac53-3ee0-4790-9953-56840696e26d"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:06.507002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8f3356df-405a-46ea-9427-9923f1b2c70b req-47d50277-71b7-4f15-9e3c-c948e17220b9 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:06.507002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8f3356df-405a-46ea-9427-9923f1b2c70b req-47d50277-71b7-4f15-9e3c-c948e17220b9 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:06.507002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8f3356df-405a-46ea-9427-9923f1b2c70b req-47d50277-71b7-4f15-9e3c-c948e17220b9 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:06.518028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-8f3356df-405a-46ea-9427-9923f1b2c70b req-47d50277-71b7-4f15-9e3c-c948e17220b9 service nova] Creating event network-vif-deleted:1d1bac53-3ee0-4790-9953-56840696e26d for instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 on hv-cinder-84914 Oct 12 00:21:06.523710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-8f3356df-405a-46ea-9427-9923f1b2c70b req-47d50277-71b7-4f15-9e3c-c948e17220b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044028 Oct 12 00:21:06.528307 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 76/147] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:06.626160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:06.626788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:06.633223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:06.633706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:06.638412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:06.639280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:06.639807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:06.640273 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:06.657063 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:06.657789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:06.664308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:06.665008 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:06.665607 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:06.666435 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:06.666955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:06.668600 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:06.721498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:06.732002 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-844239f8-9d60-44fe-bf6e-aa4bf75976bc tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1511 microversion: 2.1 time: 0.109686 Oct 12 00:21:06.732684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 72/148] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:06 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1511 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:06.848967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:06.848967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-196a6374-b6d2-4d29-85c5-ff1d51818583 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.171605 Oct 12 00:21:06.848967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 77/149] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:06 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:07.755531 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:07.756144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:07.763395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:07.763888 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:07.764317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:07.764999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:07.765477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:07.765901 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:07.833118 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:07.842843 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f6ea0dfa-8541-4824-ada6-88200e3fdf68 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1346 microversion: 2.1 time: 0.089602 Oct 12 00:21:07.842843 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 73/150] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:07 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:07.848067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:07.848732 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:07.855723 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:07.856385 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:07.856818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:07.857549 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:07.858007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:07.858432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:08.005667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:08.009348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:08.014574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-88420e8f-65f3-40ea-88e9-81e56171c007 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.170310 Oct 12 00:21:08.015228 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 78/151] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:07 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:08.863979 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:08.864586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:08.871733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:08.872205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:08.872635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:08.873313 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:08.873808 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:08.874218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:08.905032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:08.905502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:08.905924 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:08.906369 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lazy-loading 'fault' on Instance uuid a25e6edd-85e7-464f-b41c-3f2ed44ad585 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:21:08.955738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4dba90d485945e1821be4667d5a5bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbfafa65b93241bcb62d41018f6ccd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:08.963933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-72ec91fb-9d64-4c11-ba12-728247dcb729 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 200 len: 1351 microversion: 2.1 time: 0.103834 Oct 12 00:21:08.964505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 74/152] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:08 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:09.045055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:09.045872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:09.054992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:09.055593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:09.056100 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:09.056868 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:09.057393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:09.058467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:09.192955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:09.200851 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5f653823-dc59-4e43-8c3e-cae28fcce5f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.161461 Oct 12 00:21:09.201413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 79/153] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:09 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:09.994402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:09.994402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:10.000925 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:10.001337 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:10.001999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:10.002891 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:10.003449 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:10.004064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:10.019766 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] HTTP exception thrown: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Request method failure captured: Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 HTTP/1.1 Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg6jkZy9gHu29UDMIpKJSeUWJtQ3a9bJLu_fwDLNQMX6qZvT3hB_9ueSnHthx2_wiDpC0WD1GdW850rSRkhX0jdCaLHzPL-k_2sde-BzwEYnsyZI2iZQJx5gyAgs6ArszeTdEPL5uZmXq06v5XuMN8cJc0rwc0eyUY3MNXy-iNgPhs Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: bbfafa65b93241bcb62d41018f6ccd1f Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:21:10.024339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbfafa65b93241bcb62d41018f6ccd1f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: bbfafa65b93241bcb62d41018f6ccd1f Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-DeleteServersTestJSON-533855687-project Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: b4dba90d485945e1821be4667d5a5bc9 Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-DeleteServersTestJSON-533855687-project Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.025629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'a25e6edd-85e7-464f-b41c-3f2ed44ad585'} Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:21:10.026505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.027838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.028853 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Returning 404 to user: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:21:10.028853 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c858f77b-3931-404c-9ac3-714ae16109d2 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 404 len: 111 microversion: 2.1 time: 0.036866 Oct 12 00:21:10.029603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 75/154] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:09 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:21:10.139080 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:10.141260 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:10.147237 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:10.147746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:10.148170 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:10.148851 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:10.149293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:10.149708 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:10.162369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] HTTP exception thrown: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Request method failure captured: Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585/os-volume_attachments HTTP/1.1 Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg6jkZy9gHu29UDMIpKJSeUWJtQ3a9bJLu_fwDLNQMX6qZvT3hB_9ueSnHthx2_wiDpC0WD1GdW850rSRkhX0jdCaLHzPL-k_2sde-BzwEYnsyZI2iZQJx5gyAgs6ArszeTdEPL5uZmXq06v5XuMN8cJc0rwc0eyUY3MNXy-iNgPhs Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: bbfafa65b93241bcb62d41018f6ccd1f Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:21:10.166389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbfafa65b93241bcb62d41018f6ccd1f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: bbfafa65b93241bcb62d41018f6ccd1f Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-DeleteServersTestJSON-533855687-project Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: b4dba90d485945e1821be4667d5a5bc9 Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-DeleteServersTestJSON-533855687-project Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.167660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'server_id': 'a25e6edd-85e7-464f-b41c-3f2ed44ad585'} Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:21:10.168360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:10.169348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:10.170417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Returning 404 to user: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:21:10.170417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b262256f-9a02-4823-8546-1198532e7a5a tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033778 Oct 12 00:21:10.170417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 80/155] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:21:10 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:21:10.224862 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:10.225463 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:10.232233 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:10.232712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:10.233139 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:10.233821 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:10.234265 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:10.234824 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:10.373091 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:10.381178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7b0fcab9-fb13-49ba-ab64-14d242f2dad0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.160196 Oct 12 00:21:10.395764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 76/156] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:10 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:11.403755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:11.404341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:11.410141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:11.410616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:11.411044 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:11.411815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:11.412262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:11.412687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:11.546324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:11.556186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e7a0b315-d3f0-441c-92f5-b52db4bcd4b2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.156443 Oct 12 00:21:11.557229 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 81/157] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:11 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:11.593174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:11.593718 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:11.600135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:11.600609 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:11.601040 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:11.601721 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:11.602173 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:11.602588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:11.615773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] HTTP exception thrown: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Request method failure captured: Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 HTTP/1.1 Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg6jkZy9gHu29UDMIpKJSeUWJtQ3a9bJLu_fwDLNQMX6qZvT3hB_9ueSnHthx2_wiDpC0WD1GdW850rSRkhX0jdCaLHzPL-k_2sde-BzwEYnsyZI2iZQJx5gyAgs6ArszeTdEPL5uZmXq06v5XuMN8cJc0rwc0eyUY3MNXy-iNgPhs Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: bbfafa65b93241bcb62d41018f6ccd1f Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:21:11.619494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbfafa65b93241bcb62d41018f6ccd1f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: bbfafa65b93241bcb62d41018f6ccd1f Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-DeleteServersTestJSON-533855687-project Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: b4dba90d485945e1821be4667d5a5bc9 Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-DeleteServersTestJSON-533855687-project Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.621533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'a25e6edd-85e7-464f-b41c-3f2ed44ad585'} Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:21:11.622356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.623607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.624990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Returning 404 to user: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:21:11.624990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-de4002f1-0a30-431d-89bb-75e7a0474ec9 tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 404 len: 111 microversion: 2.1 time: 0.029345 Oct 12 00:21:11.624990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 77/158] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:21:11 2022] DELETE /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:21:11.627591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:11.628264 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] [instance: a25e6edd-85e7-464f-b41c-3f2ed44ad585] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:11.634094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:11.634565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:11.634992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:11.636465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:11.637154 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:11.637572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:11.651400 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] HTTP exception thrown: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Request method failure captured: Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 HTTP/1.1 Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg6jkZy9gHu29UDMIpKJSeUWJtQ3a9bJLu_fwDLNQMX6qZvT3hB_9ueSnHthx2_wiDpC0WD1GdW850rSRkhX0jdCaLHzPL-k_2sde-BzwEYnsyZI2iZQJx5gyAgs6ArszeTdEPL5uZmXq06v5XuMN8cJc0rwc0eyUY3MNXy-iNgPhs Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: bbfafa65b93241bcb62d41018f6ccd1f Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:21:11.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bbfafa65b93241bcb62d41018f6ccd1f", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bbfafa65b93241bcb62d41018f6ccd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: bbfafa65b93241bcb62d41018f6ccd1f Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-DeleteServersTestJSON-533855687 Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-DeleteServersTestJSON-533855687-project Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: b4dba90d485945e1821be4667d5a5bc9 Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-DeleteServersTestJSON-533855687-project Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.655125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'a25e6edd-85e7-464f-b41c-3f2ed44ad585'} Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:21:11.655847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. Oct 12 00:21:11.656923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:11.657810 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] Returning 404 to user: Instance a25e6edd-85e7-464f-b41c-3f2ed44ad585 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:21:11.657810 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-63efcd98-47a5-4b6c-b059-2f8a01d3abbb tempest-DeleteServersTestJSON-533855687 tempest-DeleteServersTestJSON-533855687-project] 10.222.0.36 "GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585" status: 404 len: 111 microversion: 2.1 time: 0.031212 Oct 12 00:21:11.657810 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 82/159] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:11 2022] GET /compute/v2.1/servers/a25e6edd-85e7-464f-b41c-3f2ed44ad585 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:21:12.580288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:12.580909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:12.586855 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:12.587338 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:12.591163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:12.591939 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:12.592383 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:12.592810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:12.792482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:12.801766 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d3378bad-7624-446e-a522-c427ed92e449 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.225240 Oct 12 00:21:12.802435 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 78/160] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:12 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:13.825012 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:13.826378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:13.836591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:13.839148 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:13.839834 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:13.840862 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:13.841514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:13.842357 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:14.071692 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:14.082235 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fd990f12-cf30-4215-9a85-db69babdffaa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.261049 Oct 12 00:21:14.082817 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 83/161] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:13 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:15.113253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:15.114215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:15.122433 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:15.123260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:15.128351 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:15.128351 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:15.128351 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:15.128351 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:15.522986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:15.532483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-95293e51-3831-4c75-ac87-fefae7c2dbab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.426543 Oct 12 00:21:15.535009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 79/162] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:15 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:16.555129 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:16.555765 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:16.568272 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:16.569017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:16.572326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:16.576846 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:16.576846 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:16.576846 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:16.777248 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:16.787784 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2a2dd411-34a0-4e5a-a961-24ace1fdba72 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.234596 Oct 12 00:21:16.787784 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 84/163] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:16 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:17.809364 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:17.810099 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:17.816467 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:17.816972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:17.817398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:17.818377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:17.818824 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:17.819242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:17.968766 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:17.980266 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d2ad298b-6c99-418d-8f54-ddadfeda9bb3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.175269 Oct 12 00:21:17.999759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 80/164] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:17 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:19.004881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:19.005517 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:19.014431 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:19.014947 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:19.016751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:19.021966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:19.021966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:19.021966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:19.257946 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:19.270344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-464466fe-e31c-4efa-8b69-ccb7a84a98a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.270152 Oct 12 00:21:19.276146 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 85/165] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:18 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:20.302223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:20.302824 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:20.308876 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:20.309351 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:20.309780 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:20.310460 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:20.310902 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:20.311317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:20.441621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:20.449985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-35540f95-015a-45d6-a33a-cc7c45c6afc3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.151805 Oct 12 00:21:20.450553 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 81/166] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:20 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:21.473278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:21.474754 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:21.484457 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:21.485224 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:21.487109 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:21.488013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:21.488745 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:21.489378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:21.630773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:21.640731 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b3ebb693-b98f-40ab-8c8f-c9cbb9252ea2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.170329 Oct 12 00:21:21.652021 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 86/167] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:21 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:22.665192 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:22.665928 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:22.672850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:22.673333 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:22.673764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:22.676011 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:22.684509 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:22.684509 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:22.711045 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:22.969595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:22.977700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3b70dd48-3e3a-4071-9781-e5614f6f31d6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.316368 Oct 12 00:21:22.978276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 82/168] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:22 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:24.002118 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:24.005252 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:24.012628 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:24.013965 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:24.015027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:24.015693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:24.016859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:24.017404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:24.184555 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:24.196091 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-530224a8-4b84-4fac-96d9-a83ecb1097c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.198184 Oct 12 00:21:24.199938 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 87/169] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:23 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:25.225220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:25.226197 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:25.234138 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:25.234623 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:25.235048 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:25.235777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:25.236216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:25.242031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:25.475691 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:25.484253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1a773fc2-c8fc-422b-a635-cd9a2487f64b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.266035 Oct 12 00:21:25.484846 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 83/170] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:25 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:26.508839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:26.510536 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:26.526236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:26.526948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:26.527654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:26.528804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:26.529269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:26.529697 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:26.883991 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:26.895330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f4942991-759d-4777-b2f5-89b0dcb1118a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.390202 Oct 12 00:21:26.897501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 88/171] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:26 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:27.930827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:27.932127 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:27.945815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:27.946320 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:27.949769 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:27.950588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:27.951125 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:27.951593 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:28.254123 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:28.266105 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-97a89e78-de2e-4984-8216-2a85d7b103b3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.348159 Oct 12 00:21:28.279398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 84/172] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:27 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:28.580665 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-83e3438d-daaf-46dd-acdc-fbce25467624 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'create', calling method: .version_select at 0x7f2fe902f670>, body: {"keypair": {"name": "tempest-keypair-1229662495", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUXFlgtABVxHBGPTQSAFLgpGrtByzUVi9ZTVFmv4lmh1j3zsipj8NqBd6JVSCGAh9WyXxcR41l6ya7eQ9Aj3ruzwdTqjCGLhJYiHn6r5g6xCwd8R//eDVTezCxBfG+WVA=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:28.601285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-83e3438d-daaf-46dd-acdc-fbce25467624 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Getting quotas for project 13bdb0f5c58a40af9e420f6072f2f2b0. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:21:28.605403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-83e3438d-daaf-46dd-acdc-fbce25467624 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Getting quotas for user 63474c55edbf4b22ad609471a2414ede and project 13bdb0f5c58a40af9e420f6072f2f2b0. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:21:28.785824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-83e3438d-daaf-46dd-acdc-fbce25467624 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.366012 Oct 12 00:21:28.786464 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 89/173] 10.222.0.36 () {62 vars in 1200 bytes} [Wed Oct 12 00:21:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 367 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 00:21:29.295846 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:29.295846 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:29.301739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:29.302633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:29.303226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:29.304162 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:29.304752 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:29.305316 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:29.459680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:29.484855 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f8f97afa-3b5d-4d11-8c39-63720851ebec tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.184748 Oct 12 00:21:29.496619 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 85/174] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:29 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:30.508862 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:30.509471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:30.516970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:30.517570 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:30.518018 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:30.518721 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:30.519177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:30.519624 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:30.661627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:30.673146 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f98f447a-6aaf-4a69-998f-7676c9766aca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.167490 Oct 12 00:21:30.674981 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 90/175] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:30 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:31.106762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1266802161", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c299ee8-2b42-4994-965e-051a94d2391c"}], "security_groups": [{"name": "tempest-securitygroup--1943864047"}], "key_name": "tempest-keypair-1229662495", "user_data": "}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:31.115947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:31.442909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] validate_networks() for [('0c299ee8-2b42-4994-965e-051a94d2391c', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:21:31.701028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:31.702407 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:31.709159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:31.709931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:31.710943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:31.712112 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:31.712815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:31.713456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:31.860922 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:21:31.861865 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:21:31.862490 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:21:31.863009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:21:31.863506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:21:31.873962 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:31.875405 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:31.875917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:31.876728 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:31.877269 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:31.877909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:31.898556 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Getting quotas for project 13bdb0f5c58a40af9e420f6072f2f2b0. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:21:31.902765 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:31.904148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Getting quotas for user 63474c55edbf4b22ad609471a2414ede and project 13bdb0f5c58a40af9e420f6072f2f2b0. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:21:31.910837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-74ad35e3-5e6e-457c-b0ba-b36fceebb2a8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.215341 Oct 12 00:21:31.911782 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 91/176] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:31 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:31.919206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:21:31.920634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:21:32.043026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f36baaeb-6a9e-4c22-9729-64306eab193d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.940603 Oct 12 00:21:32.044040 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 86/177] 10.222.0.36 () {62 vars in 1188 bytes} [Wed Oct 12 00:21:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 12 00:21:32.055935 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9ac32215-5bab-407a-bc58-cd2996cb0f11 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:32.057271 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9ac32215-5bab-407a-bc58-cd2996cb0f11 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:32.113110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9ac32215-5bab-407a-bc58-cd2996cb0f11 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:32.121080 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9ac32215-5bab-407a-bc58-cd2996cb0f11 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:32.122513 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9ac32215-5bab-407a-bc58-cd2996cb0f11 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:32.123626 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9ac32215-5bab-407a-bc58-cd2996cb0f11 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1282 microversion: 2.20 time: 0.071666 Oct 12 00:21:32.124234 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 92/178] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:32 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:32.382319 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1067723305", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "networks": [{"uuid": "fccd9e59-39c7-42a2-aa54-28f6a75073c4"}]}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:32.434734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] validate_networks() for [('fccd9e59-39c7-42a2-aa54-28f6a75073c4', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:21:32.784983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:21:32.785395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:21:32.786221 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:21:32.793730 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:21:32.794395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:21:32.810403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:32.811391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:32.812035 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:32.812961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:32.814239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:32.815049 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:32.836102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Getting quotas for project 4194baa4b1fe4ab2840720dbf012a2f3. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:21:32.841025 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Getting quotas for user b0791b4507cf48bca517f41f0feebd78 and project 4194baa4b1fe4ab2840720dbf012a2f3. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:21:32.852550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:21:32.855013 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:21:32.943796 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:32.944931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:32.951640 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:32.952295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:32.952738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:32.953755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:32.953946 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:32.954377 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:33.019213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f19b1c1c-9c44-4266-8469-41df7b88aa4c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641717 Oct 12 00:21:33.020107 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 87/179] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:21:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:21:33.031660 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7d44b063-b489-4669-91d0-589723b1de2a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:33.032270 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7d44b063-b489-4669-91d0-589723b1de2a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:33.087240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7d44b063-b489-4669-91d0-589723b1de2a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:33.096978 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7d44b063-b489-4669-91d0-589723b1de2a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1219 microversion: 2.1 time: 0.069187 Oct 12 00:21:33.097624 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 88/180] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:33 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:33.110611 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:33.118663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-03d1e9b9-9a29-43bd-ad39-7d91b84d87a0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1521 microversion: 2.1 time: 0.178578 Oct 12 00:21:33.136902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 93/181] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:32 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:33.149137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5bb3d981-1ddc-4c6e-99cc-4adabc20e915 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:33.149658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5bb3d981-1ddc-4c6e-99cc-4adabc20e915 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:33.218453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5bb3d981-1ddc-4c6e-99cc-4adabc20e915 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:33.226659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5bb3d981-1ddc-4c6e-99cc-4adabc20e915 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:33.228338 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5bb3d981-1ddc-4c6e-99cc-4adabc20e915 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:33.229457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5bb3d981-1ddc-4c6e-99cc-4adabc20e915 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1282 microversion: 2.20 time: 0.084191 Oct 12 00:21:33.230303 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 89/182] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:33 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:34.123124 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-00eb8c3e-7b5e-4668-8330-1931e9c278b3 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:34.123769 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-00eb8c3e-7b5e-4668-8330-1931e9c278b3 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:34.148654 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:34.149806 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:34.156988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:34.160274 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:34.160274 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:34.160274 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:34.160274 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:34.160611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:34.182160 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-00eb8c3e-7b5e-4668-8330-1931e9c278b3 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:34.193544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-00eb8c3e-7b5e-4668-8330-1931e9c278b3 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1219 microversion: 2.1 time: 0.074827 Oct 12 00:21:34.194509 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 94/183] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:34 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:34.254116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:34.254896 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:34.261431 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:34.261967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:34.262569 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:34.263724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:34.264456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:34.264863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:34.314531 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:34.340346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2eab7d9b-b866-4b25-84cb-78ee8b63c48f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1501 microversion: 2.1 time: 0.195414 Oct 12 00:21:34.341490 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 90/184] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:34 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1501 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:34.360845 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:34.378663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:34.380749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:34.382352 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3dd9b1a2-a1a1-4629-9ba9-f3d891ecae3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1278 microversion: 2.20 time: 0.132031 Oct 12 00:21:34.382763 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:34.383511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 95/185] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:34 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:21:34.383627 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:34.395345 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:34.402649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:34.403172 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:34.404152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:34.404658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:34.405154 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:34.551916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:34.559673 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f4b37130-9d6a-461d-8ae4-473a39bd99a9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1516 microversion: 2.1 time: 0.186520 Oct 12 00:21:34.560249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 91/186] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:34 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1516 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:35.217833 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:35.218438 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:35.229405 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:35.232943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:35.232943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:35.232943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:35.232943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:35.233364 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:35.333503 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:35.342125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-abfae1b3-4248-48b9-9409-e2b497fa554c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1271 microversion: 2.1 time: 0.127992 Oct 12 00:21:35.351487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 96/187] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:35 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:35.410500 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:35.411764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:35.420631 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:35.421483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:35.421933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:35.422695 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:35.423302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:35.423752 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:35.494071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:35.504080 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:35.505987 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:35.507765 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4d9352dd-1e21-4228-b783-b93bcfcc03ff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1342 microversion: 2.20 time: 0.101225 Oct 12 00:21:35.508651 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 92/188] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:35 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1342 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:36.374112 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:36.374801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:36.381401 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:36.382076 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:36.382574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:36.382971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:36.383964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:36.385269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:36.385786 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:36.385962 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:36.394383 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:36.395134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:36.395603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:36.396340 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:36.396857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:36.397282 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:36.426132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lazy-loading 'flavor' on Instance uuid f9bf92f4-feae-4c05-afff-d0daff3371e3 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:21:36.481388 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:36.492146 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-761036b2-71f7-4fb1-a917-f4207da3a0a2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1289 microversion: 2.1 time: 0.123461 Oct 12 00:21:36.492727 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 97/189] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:36 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:36.536716 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:36.541413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:36.541413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:36.546373 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:36.547024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:36.547277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:36.548007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:36.548457 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:36.548877 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:36.833868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-13607ab4-ca9b-451e-bec6-d6c335f5de15 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3/action" status: 200 len: 32 microversion: 2.1 time: 0.459649 Oct 12 00:21:36.834506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 93/190] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:21:36 2022] POST /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 00:21:36.845290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:36.845912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:36.855708 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:36.856211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:36.856652 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:36.857359 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:36.857812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:36.858243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:37.004236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:37.013046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:37.014470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:37.015788 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0a7719b0-2e70-4979-b59f-e96daca95713 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1408 microversion: 2.20 time: 0.483047 Oct 12 00:21:37.016359 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 98/191] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:36 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:21:37.137476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:37.146104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0a8d7fe4-22dc-4ae8-adb3-ca1f8580566b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.305213 Oct 12 00:21:37.146837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 94/192] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:36 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:37.516636 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:37.517273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:37.523717 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:37.524229 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:37.524670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:37.525926 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:37.526382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:37.526807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:37.588860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-f99fc119-76b1-4e7a-a1d6-f3c6cd4003ba req-2d291abe-4f26-4ca7-a3af-5b429a16f2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce674c-f9e8-476b-b1e2-fe18ba36050a", "tag": "2dccc06d-e6ad-4199-a897-4c5df8e17ccf"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:37.603250 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-f99fc119-76b1-4e7a-a1d6-f3c6cd4003ba req-2d291abe-4f26-4ca7-a3af-5b429a16f2ee service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:37.604003 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-f99fc119-76b1-4e7a-a1d6-f3c6cd4003ba req-2d291abe-4f26-4ca7-a3af-5b429a16f2ee service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:37.605100 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-f99fc119-76b1-4e7a-a1d6-f3c6cd4003ba req-2d291abe-4f26-4ca7-a3af-5b429a16f2ee service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:37.617016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-f99fc119-76b1-4e7a-a1d6-f3c6cd4003ba req-2d291abe-4f26-4ca7-a3af-5b429a16f2ee service nova] Creating event network-changed:2dccc06d-e6ad-4199-a897-4c5df8e17ccf for instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a on hv-cinder-84914 Oct 12 00:21:37.622900 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-f99fc119-76b1-4e7a-a1d6-f3c6cd4003ba req-2d291abe-4f26-4ca7-a3af-5b429a16f2ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039056 Oct 12 00:21:37.624196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 95/193] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:21:37.819677 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:37.824617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:37.830299 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7945f378-0381-4282-82f2-bb8254e8d605 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.317815 Oct 12 00:21:37.843698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 99/194] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:37 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:38.042987 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:38.043705 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:38.049820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:38.050295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:38.050723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:38.051476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:38.051931 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:38.052354 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:38.170044 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:38.172151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:38.178448 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:38.184114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:38.184114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:38.184114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:38.184114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:38.184681 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:38.287674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:38.297913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:38.299659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:38.300860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-82a2766f-0c45-4f2d-8ae8-684386ac1be4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1408 microversion: 2.20 time: 0.263078 Oct 12 00:21:38.301803 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 96/195] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:38 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1408 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:38.419960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:38.433259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-53e15b8b-a77e-4c81-980d-9136f09d2801 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.267610 Oct 12 00:21:38.433852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 100/196] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:38 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:38.609562 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-76aa8cc4-ffc7-461c-9e3f-7bd2a53d439e req-ed274082-be4e-44f0-acdc-d074a7a52c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9c8dee-c875-4d23-a52e-5cd497cb44a9", "tag": "e3d5ab75-eab0-4395-90b9-5ea8ff2ffa6e"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:38.620247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-76aa8cc4-ffc7-461c-9e3f-7bd2a53d439e req-ed274082-be4e-44f0-acdc-d074a7a52c74 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:38.620965 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-76aa8cc4-ffc7-461c-9e3f-7bd2a53d439e req-ed274082-be4e-44f0-acdc-d074a7a52c74 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:38.621563 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-76aa8cc4-ffc7-461c-9e3f-7bd2a53d439e req-ed274082-be4e-44f0-acdc-d074a7a52c74 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:38.632966 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-76aa8cc4-ffc7-461c-9e3f-7bd2a53d439e req-ed274082-be4e-44f0-acdc-d074a7a52c74 service nova] Creating event network-changed:e3d5ab75-eab0-4395-90b9-5ea8ff2ffa6e for instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 on hv-cinder-84914 Oct 12 00:21:38.637975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-76aa8cc4-ffc7-461c-9e3f-7bd2a53d439e req-ed274082-be4e-44f0-acdc-d074a7a52c74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031984 Oct 12 00:21:38.638890 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 97/197] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:38.854123 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:38.854745 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:38.864292 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:38.864292 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:38.864292 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:38.864292 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:38.864801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:38.864801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:39.008426 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:39.016913 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f7fdd6b3-0eec-4936-ac69-49fce00dd992 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.166879 Oct 12 00:21:39.017469 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 101/198] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:38 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:39.326881 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:39.327611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:39.333663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:39.334144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:39.334575 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:39.335267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:39.335770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:39.336374 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:39.456096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:39.456701 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:39.462752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:39.463240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:39.463706 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:39.464407 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:39.464857 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:39.465280 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:39.466304 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:39.474475 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:39.475940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:39.477029 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-22fbd569-42bd-4f7b-a883-d7bf289eefcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1408 microversion: 2.20 time: 0.154402 Oct 12 00:21:39.477681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 98/199] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:39 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:39.593449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:39.601166 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8f31e2f0-3c15-4024-9a5a-ab6c7869a4c6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.148977 Oct 12 00:21:39.601731 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 102/200] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:39 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:40.039994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:40.041382 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:40.047662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:40.048148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:40.048582 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:40.049281 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:40.049736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:40.050159 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:40.438829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:40.447183 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6a0d82e0-373d-4a90-a5d3-885776551c8c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.410497 Oct 12 00:21:40.447785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 99/201] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:40 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:40.503018 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:40.503666 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:40.510487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:40.510958 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:40.511408 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:40.512094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:40.512543 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:40.513266 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:40.625336 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:40.626232 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:40.632988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:40.633468 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:40.633892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:40.635501 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:40.635950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:40.636374 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:40.650855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:40.662042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:40.664068 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:40.665780 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3064aa0d-a73a-4f09-afef-c4cef9bd196e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1408 microversion: 2.20 time: 0.166402 Oct 12 00:21:40.666346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 103/202] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:40 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:40.772213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:40.780030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2ba7b705-7a64-469d-8d66-0a804690c01b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.158636 Oct 12 00:21:40.780595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 100/203] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:40 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:41.469812 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:41.470421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:41.476369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:41.476845 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:41.477279 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:41.478526 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:41.478977 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:41.479431 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:41.610186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:41.616653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0eac16e7-2505-448d-a4f2-7f8f712f9c9d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.150771 Oct 12 00:21:41.617216 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 104/204] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:41 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:41.691280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:41.692007 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:41.699102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:41.699668 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:41.703385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:41.703385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:41.703385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:41.703385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:41.803594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:41.804252 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:41.810323 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:41.812561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:41.812561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:41.812561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:41.812561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:41.813163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:41.832226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:41.835781 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:41.841351 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:41.842836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:41.843962 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-082e434b-9782-44fb-b21f-2d2af375ff59 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1408 microversion: 2.20 time: 0.156665 Oct 12 00:21:41.844515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 101/205] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:41 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:41.944591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:41.952641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b86df900-4285-4d12-9141-1be000bca2ac tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.153893 Oct 12 00:21:41.953205 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 105/206] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:41 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:42.639674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:42.640278 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:42.646964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:42.653755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:42.653755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:42.653755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:42.653755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:42.654099 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:42.781533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:42.789325 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d7aeaf69-8dd2-4562-aa91-bef01ea88f58 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.153847 Oct 12 00:21:42.789905 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 102/207] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:42 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:42.810985 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:42.811558 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:42.819594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:42.820070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:42.820638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:42.821329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:42.821771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:42.822185 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:42.845973 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f446970e-4363-44f5-8ceb-c8e98c243fa4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/ips" status: 200 len: 149 microversion: 2.1 time: 0.051204 Oct 12 00:21:42.846683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 106/208] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:21:42 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:42.867358 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:42.867990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:42.870276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=4 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:42.875507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:42.875997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:42.876430 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:42.877312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:42.877767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:42.878346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:42.976843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:42.978113 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:42.984866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:42.985733 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:42.986171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:42.987127 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:42.987826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:42.988356 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:43.049163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:43.059170 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:43.061598 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:43.063180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1a195e9b-b3b3-4cc7-a119-412e8226898a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1408 microversion: 2.20 time: 0.199714 Oct 12 00:21:43.064822 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 103/209] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:42 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:43.131310 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:43.139313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7a1cc34b-76f3-4c43-98b4-18ccad081af5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.167300 Oct 12 00:21:43.148652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 107/210] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:42 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:43.813527 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:43.814130 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:43.816362 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=16 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:43.822730 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:43.823259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:43.828868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:43.828868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:43.828868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:43.828868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:43.956731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:43.965068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d73e2aab-ee78-402e-a17d-e5e7d7a08fc0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.155333 Oct 12 00:21:43.968923 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 104/211] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:43 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:43.983855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-62a0b865-9571-4e46-9553-2cff7c545464 req-baf29f08-9057-4a48-abc4-609d4c9d1220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce674c-f9e8-476b-b1e2-fe18ba36050a", "name": "network-vif-plugged", "status": "completed", "tag": "2dccc06d-e6ad-4199-a897-4c5df8e17ccf"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:43.996738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-62a0b865-9571-4e46-9553-2cff7c545464 req-baf29f08-9057-4a48-abc4-609d4c9d1220 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:43.997389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-62a0b865-9571-4e46-9553-2cff7c545464 req-baf29f08-9057-4a48-abc4-609d4c9d1220 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:43.997994 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-62a0b865-9571-4e46-9553-2cff7c545464 req-baf29f08-9057-4a48-abc4-609d4c9d1220 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:44.009588 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-62a0b865-9571-4e46-9553-2cff7c545464 req-baf29f08-9057-4a48-abc4-609d4c9d1220 service nova] Creating event network-vif-plugged:2dccc06d-e6ad-4199-a897-4c5df8e17ccf for instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a on hv-cinder-84914 Oct 12 00:21:44.015287 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-62a0b865-9571-4e46-9553-2cff7c545464 req-baf29f08-9057-4a48-abc4-609d4c9d1220 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035358 Oct 12 00:21:44.016285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 108/212] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:44.090497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:44.091306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:44.098019 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:44.098581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:44.099081 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:44.100043 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:44.100568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:44.101243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:44.164888 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:44.166210 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:44.176437 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:44.177742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:44.178263 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:44.179330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:44.182177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:44.182177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:44.189328 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=8 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:44.247984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:44.256554 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:44.258075 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:44.259228 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-872c996f-c48d-4adc-9e63-c19ef695d763 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1408 microversion: 2.20 time: 0.172674 Oct 12 00:21:44.259819 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 105/213] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:44 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:44.328542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:44.336520 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a433a214-b63c-4df5-91dc-2154559e52cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.177994 Oct 12 00:21:44.337630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 109/214] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:44 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:44.643982 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29f41764-fe52-49a9-ad4d-8139a0619070"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:44.646802 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:44.653189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:44.653660 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:44.654135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:44.654822 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:44.655268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:44.655704 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:44.991270 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:44.995309 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:44.998399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:44.998956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:44.999485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:45.000168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:45.000615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:45.001030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:45.132031 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:45.140554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aa2ccf45-8f33-46c4-b197-184acc748161 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.153053 Oct 12 00:21:45.141121 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 110/215] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:44 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:45.283901 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:45.284442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:45.290416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:45.290899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:45.291332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:45.292048 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:45.292501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:45.292929 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:45.432604 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:45.451575 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:45.451575 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:45.451575 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f20b1d9a-a048-4ba1-ab9b-625f3960aca2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1408 microversion: 2.20 time: 0.163571 Oct 12 00:21:45.452026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 111/216] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:45 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:21:45.452026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:45.452026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:45.455919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:45.456112 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:45.456674 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:45.457370 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:45.457825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:45.458255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:45.598758 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:45.607931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-68b46056-c017-4bbc-8728-8cb13bcd8a32 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.162938 Oct 12 00:21:45.608531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 112/217] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:45 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:45.851101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a0b5de11-6877-4ab2-813e-49ed9817e932 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.211337 Oct 12 00:21:45.851756 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 106/218] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:21:44 2022] POST /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments => generated 194 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:46.029270 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-c3a57381-323d-45f5-9e17-71ee9c9a3f74 req-4e6c8a18-931e-43dd-80e1-a1204fd96403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9c8dee-c875-4d23-a52e-5cd497cb44a9", "name": "network-vif-plugged", "status": "completed", "tag": "e3d5ab75-eab0-4395-90b9-5ea8ff2ffa6e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:46.038662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c3a57381-323d-45f5-9e17-71ee9c9a3f74 req-4e6c8a18-931e-43dd-80e1-a1204fd96403 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.039165 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c3a57381-323d-45f5-9e17-71ee9c9a3f74 req-4e6c8a18-931e-43dd-80e1-a1204fd96403 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.039630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c3a57381-323d-45f5-9e17-71ee9c9a3f74 req-4e6c8a18-931e-43dd-80e1-a1204fd96403 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.050280 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-c3a57381-323d-45f5-9e17-71ee9c9a3f74 req-4e6c8a18-931e-43dd-80e1-a1204fd96403 service nova] Creating event network-vif-plugged:e3d5ab75-eab0-4395-90b9-5ea8ff2ffa6e for instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 on hv-cinder-84914 Oct 12 00:21:46.055259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-c3a57381-323d-45f5-9e17-71ee9c9a3f74 req-4e6c8a18-931e-43dd-80e1-a1204fd96403 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029755 Oct 12 00:21:46.055855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 113/219] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:46.163814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:46.164443 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:46.171059 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.171592 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.172027 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.172721 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.173180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.173608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.303941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:46.312140 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-047d26d6-934a-47df-9dcf-194042643d07 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.152659 Oct 12 00:21:46.312703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 107/220] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:46 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:46.363133 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:46.363754 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:46.369931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.371114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.371568 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.372820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.373276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.373692 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.397053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-54a30fb3-820b-4950-95ab-5f6486170700 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/ips" status: 200 len: 145 microversion: 2.1 time: 0.038087 Oct 12 00:21:46.397609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 114/221] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:21:46 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:46.470699 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:46.471404 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:46.479934 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.480719 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.481390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.482450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.482893 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.483626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.630032 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:46.630734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:46.634462 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:46.639710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.643060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.643574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.644292 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.644862 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.645178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.645556 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:46.647060 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:46.648300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f96b6feb-a05c-45de-847b-32211d1746bf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1600 microversion: 2.20 time: 0.182266 Oct 12 00:21:46.649048 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 108/222] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:21:46 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1600 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:21:46.674441 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:46.674960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:46.683773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.684529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.685115 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.687054 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:46.687054 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:46.687054 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:46.802149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:46.807804 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f9d2c80d-3fdb-4a80-9012-8d4d2caa3906 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.137133 Oct 12 00:21:46.808437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 109/223] 10.222.0.36 () {60 vars in 1316 bytes} [Wed Oct 12 00:21:46 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 00:21:46.813579 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-41bb66ff-9879-48d5-8762-eb541a68e807 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.187266 Oct 12 00:21:46.814142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 115/224] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:46 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:47.334913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:47.335626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:47.341836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:47.342310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:47.342914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:47.343653 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:47.344100 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:47.344681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:47.567625 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:47.576249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a6e364d8-dfa6-4a66-8cb6-5e7053575d10 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1319 microversion: 2.1 time: 0.245119 Oct 12 00:21:47.576829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 110/225] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:47 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:47.836572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:47.837168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:47.843087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:47.843600 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:47.844028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:47.844710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:47.845153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:47.845569 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:47.927177 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-145d264e-74ae-4210-bbe2-04df2ea7baa2 req-ac410027-b843-4a78-ad52-7634e06faab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ce674c-f9e8-476b-b1e2-fe18ba36050a", "tag": "2dccc06d-e6ad-4199-a897-4c5df8e17ccf"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:47.937107 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-145d264e-74ae-4210-bbe2-04df2ea7baa2 req-ac410027-b843-4a78-ad52-7634e06faab4 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:47.937576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-145d264e-74ae-4210-bbe2-04df2ea7baa2 req-ac410027-b843-4a78-ad52-7634e06faab4 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:47.937998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-145d264e-74ae-4210-bbe2-04df2ea7baa2 req-ac410027-b843-4a78-ad52-7634e06faab4 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:47.950569 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-145d264e-74ae-4210-bbe2-04df2ea7baa2 req-ac410027-b843-4a78-ad52-7634e06faab4 service nova] Creating event network-changed:2dccc06d-e6ad-4199-a897-4c5df8e17ccf for instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a on hv-cinder-84914 Oct 12 00:21:47.955817 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-145d264e-74ae-4210-bbe2-04df2ea7baa2 req-ac410027-b843-4a78-ad52-7634e06faab4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032626 Oct 12 00:21:47.956422 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 111/226] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:21:48.003383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:48.011865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c5c2df74-1177-4e9f-89de-d0ea2e572c3c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.179008 Oct 12 00:21:48.012535 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 116/227] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:47 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:48.599860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:48.600547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:48.606718 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:48.607199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:48.607653 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:48.608332 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:48.608777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:48.609189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:48.745892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:48.748594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-01a8b641-5238-42bb-8a33-96985268dfb7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1508 microversion: 2.1 time: 0.153362 Oct 12 00:21:48.749692 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 112/228] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:48 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:49.036009 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:49.037546 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:49.046262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:49.048980 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:49.049675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:49.050407 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:49.050855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:49.051277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:49.312650 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c540623-6fbf-4c0c-a6dc-e5916769e96e"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:49.316046 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:49.323618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:49.324385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:49.325074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:49.326044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:49.326933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:49.327644 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:49.433223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:49.445746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f6fe6654-e05a-4f7c-9c12-110f5e95e674 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.412913 Oct 12 00:21:49.446755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 117/229] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:49 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:50.231734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-66edafaa-5762-4143-bc37-95dae4b90484 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.924687 Oct 12 00:21:50.232654 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 113/230] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:21:49 2022] POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/os-volume_attachments => generated 194 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:50.467919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:50.468410 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:50.479849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:50.479849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:50.479849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:50.479849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:50.480156 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:50.480156 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:50.498872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:50.622453 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:50.630529 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-628b2e26-1141-4678-99ef-fe7e4c6b287b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.166484 Oct 12 00:21:50.631118 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 118/231] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:50 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:51.655792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:51.658883 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:51.663125 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:51.663639 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:51.664064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:51.664759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:51.665203 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:51.665616 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:51.806673 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:51.815570 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-893d05c5-6179-44c4-98c0-a9f91565684e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.165112 Oct 12 00:21:51.816156 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 114/232] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:51 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:52.839843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:52.840533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:52.846507 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:52.847063 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:52.847602 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:52.848296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:52.848752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:52.849178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:52.981300 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:52.988954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bf4087a3-8484-4bdc-8993-f30a67a92bfd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.153497 Oct 12 00:21:52.989529 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 119/233] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:52 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:54.011582 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:54.012186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:54.020073 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:54.020567 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:54.020974 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:54.021741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:54.022187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:54.022663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:54.152758 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:54.160413 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ba0fe486-95e9-401d-b82f-f6e5653138f5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.152728 Oct 12 00:21:54.160972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 115/234] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:54 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:54.789814 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8cfc619e-e145-4a98-8716-870d96b965cf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: .version_select at 0x7f2fe90e6550>, body: {"keypair": {"name": "tempest-keypair-376412044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN4/AAbg/Ko3JzgJdABHMzJ7p8d2dgq9Y4W2jamkYyAqeNVVHkFlfG+mEMiTMwfFHXVqJpdJU+5aBt0SEgXFHAGZR/Op37juCX7SB4Oql5FNcVA+hPws/KgmdgnNbmLHA=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:54.804883 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-8cfc619e-e145-4a98-8716-870d96b965cf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for project 10160596b45c49249155b0c2585e70bb. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:21:54.809310 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-8cfc619e-e145-4a98-8716-870d96b965cf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for user de766cb582ba4c18b1fda9bf4ad43f65 and project 10160596b45c49249155b0c2585e70bb. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:21:54.937048 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8cfc619e-e145-4a98-8716-870d96b965cf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151044 Oct 12 00:21:54.939467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 120/235] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:21:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:21:55.183767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:55.185143 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:55.193142 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:55.194178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:55.194178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:55.194711 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:55.195324 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:55.196965 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:55.358176 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:55.362056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:55.366623 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5120c2ce-1979-4995-8540-7ed33ad4a7e6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.187504 Oct 12 00:21:55.367195 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 116/236] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:55 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:56.391957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:56.392672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:56.399299 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:56.399847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:56.400279 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:56.401018 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:56.401473 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:56.401895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:56.576909 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:56.584505 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-89b751bd-0f8e-40da-b157-16ab528b5f8e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.197142 Oct 12 00:21:56.585198 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 121/237] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:56 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:57.363518 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1374140333", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7f2d8cc-4d82-4295-a149-404a55bcd20c"}], "security_groups": [{"name": "tempest-securitygroup--1779900911"}], "key_name": "tempest-keypair-376412044", "user_data": "}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:57.609531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:57.610345 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:57.616083 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] validate_networks() for [('a7f2d8cc-4d82-4295-a149-404a55bcd20c', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:21:57.617557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:57.618209 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:57.618852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:57.620241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:57.621234 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:57.621653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:57.778986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:57.787653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3bd10136-c574-4789-85dd-e506e10af83f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1502 microversion: 2.1 time: 0.182482 Oct 12 00:21:57.788449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 122/238] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:57 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:57.812828 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03630cab-ae7d-40ad-9ac0-dff8ada0492b"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:57.815244 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:57.822331 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:57.823645 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:57.824386 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:57.825095 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:57.825542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:57.825959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:57.851842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] HTTP exception thrown: Cannot 'attach_volume' instance f9bf92f4-feae-4c05-afff-d0daff3371e3 while it is in vm_state rescued Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Request method failure captured: Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: POST /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3/os-volume_attachments HTTP/1.1 Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 74 Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg4D5QpA122m4lveLfp-9wK4wQY1TE92U5jGpsoHvTIDe3sVfW71KUvl95hjGK9nabV-xPoWv_cueB36pe1p0iuF5EEjQbKRkVvXU96pA9dHpMADtwbatpjx02JePAouRZp5PfqxNe6tBM68X2Kurf9NMVBV7WSgbG7GXeRsglkyD4 Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:21:57.853613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38c7ea1f3f9848b484a56cf74a2bd129", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: cdd87151f3af4a3bb1c3815db5d0e8fa Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {"volumeAttachment": {"volumeId": "03630cab-ae7d-40ad-9ac0-dff8ada0492b"}} Oct 12 00:21:57.855472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Cannot 'attach_volume' instance f9bf92f4-feae-4c05-afff-d0daff3371e3 while it is in vm_state rescued Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'server_id': 'f9bf92f4-feae-4c05-afff-d0daff3371e3', 'body': {'volumeAttachment': {'volumeId': '03630cab-ae7d-40ad-9ac0-dff8ada0492b'}}} Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f9bf92f4-feae-4c05-afff-d0daff3371e3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:21:57.856476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f9bf92f4-feae-4c05-afff-d0daff3371e3 while it is in vm_state rescued Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:21:57.858062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:21:57.859073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:21:57.859073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:21:57.859073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f9bf92f4-feae-4c05-afff-d0daff3371e3 while it is in vm_state rescued Oct 12 00:21:57.859073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:21:57.859073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Returning 409 to user: Cannot 'attach_volume' instance f9bf92f4-feae-4c05-afff-d0daff3371e3 while it is in vm_state rescued {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:21:57.859073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8b134e2c-e4a0-4256-b180-fd8300492927 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048209 Oct 12 00:21:57.859073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 123/239] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:21:57 2022] POST /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 12 00:21:57.866972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:21:57.867549 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:57.874647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:57.875154 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:57.875623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:57.876368 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:57.876816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:57.882764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:58.092477 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fab12f72-4983-4f13-a647-c1215819e77d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3/action" status: 202 len: 0 microversion: 2.1 time: 0.229297 Oct 12 00:21:58.093103 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 124/240] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:21:57 2022] POST /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:21:58.102771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:58.103500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:58.112795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:58.113420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:58.113979 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:58.114667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:58.115273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:58.115958 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:58.272496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:58.281948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-765e103f-9faf-4725-93a7-1cc91c2e9f75 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1510 microversion: 2.1 time: 0.183824 Oct 12 00:21:58.283064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 125/241] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:58 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:58.401997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:21:58.402544 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:21:58.402870 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:21:58.403361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:21:58.403945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:21:58.405970 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:21:58.415024 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:58.415535 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:58.416661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:58.417672 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:58.418293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:58.418706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:58.438186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for project 10160596b45c49249155b0c2585e70bb. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:21:58.446346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for user de766cb582ba4c18b1fda9bf4ad43f65 and project 10160596b45c49249155b0c2585e70bb. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:21:58.461925 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:21:58.465105 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:21:58.580993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b242f6a4-3ffa-4445-8c6f-ef1dd5cc1085 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.221738 Oct 12 00:21:58.581740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 117/242] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:21:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:21:58.593625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-097db356-dc6b-494f-959a-9eeb093e757c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:58.594520 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-097db356-dc6b-494f-959a-9eeb093e757c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:58.657307 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-097db356-dc6b-494f-959a-9eeb093e757c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:58.671745 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-097db356-dc6b-494f-959a-9eeb093e757c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1241 microversion: 2.1 time: 0.081531 Oct 12 00:21:58.672931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 126/243] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:58 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:21:59.307775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:59.308972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:59.315408 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:59.315930 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:59.316916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:59.317067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:59.317518 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:59.317938 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:59.467540 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:59.475578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0142c367-e538-4503-b684-54484bae930b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1510 microversion: 2.1 time: 0.172784 Oct 12 00:21:59.476145 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 118/244] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:59 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:21:59.695868 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:21:59.696482 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:21:59.703019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:59.703584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:59.704009 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:59.704703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:21:59.705157 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:21:59.705585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:21:59.773615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:21:59.785568 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9c5c93ae-6fa3-4f4c-9443-930da1b60aed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1245 microversion: 2.1 time: 0.093508 Oct 12 00:21:59.786195 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 127/245] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:21:59 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:00.499515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:00.500024 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:00.506615 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:00.507105 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:00.507588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:00.508279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:00.508738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:00.509240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:00.684527 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:00.693327 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0817c90d-7f07-437d-8b51-22a3e4fe8f34 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1510 microversion: 2.1 time: 0.197668 Oct 12 00:22:00.694006 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 119/246] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:00 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:00.808733 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:00.809885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:00.816481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:00.816958 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:00.817383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:00.818073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:00.818515 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:00.819033 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:00.935907 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:00.947460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6a2dd68c-bff9-41b4-aa19-a76c83d2525c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1245 microversion: 2.1 time: 0.142754 Oct 12 00:22:00.949129 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 128/247] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:00 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1245 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:01.717877 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:01.720762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:01.729597 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:01.730087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:01.730525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:01.731235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:01.731756 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:01.732148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:01.878384 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:01.887404 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-527c4400-99ff-414c-bd82-59f4f6e64654 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1510 microversion: 2.1 time: 0.173385 Oct 12 00:22:01.888281 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 120/248] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:01 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:01.974212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:01.975544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:02.000017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:02.005158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:02.005158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:02.008109 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:02.012352 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:02.014001 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:02.126014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:02.142738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3b443717-a98c-4e62-9b4f-552eca14b31b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1237 microversion: 2.1 time: 0.173284 Oct 12 00:22:02.145016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 129/249] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:01 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1237 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:02.910215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:02.910820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:02.917412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:02.917899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:02.918333 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:02.919016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:02.919694 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:02.920111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:03.061398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:03.084807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e6e56063-9909-428a-ae5e-089824c55b2a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1516 microversion: 2.1 time: 0.178434 Oct 12 00:22:03.086190 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 121/250] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:02 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:03.167977 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:03.169163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:03.179469 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:03.180298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:03.185413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:03.185413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:03.185413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:03.185413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:03.295553 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:03.314313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-71ff8e5d-8949-49e3-91c2-7708b634537a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1293 microversion: 2.1 time: 0.150044 Oct 12 00:22:03.316748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 130/251] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:03 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1293 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:04.315072 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8d7f99fe-0a16-4891-a3f3-e3955bec7597 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:04.323195 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d7f99fe-0a16-4891-a3f3-e3955bec7597 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:04.323742 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d7f99fe-0a16-4891-a3f3-e3955bec7597 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:04.324526 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8d7f99fe-0a16-4891-a3f3-e3955bec7597 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:04.338642 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:04.342378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:04.347391 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:04.347888 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:04.348319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:04.349212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:04.349660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:04.350083 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:04.414825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8d7f99fe-0a16-4891-a3f3-e3955bec7597 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Going to try to stop instance {{(pid=125809) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 00:22:04.425619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:04.433891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-648cb4cf-54e4-40d4-b2ba-9538a3e05e39 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1293 microversion: 2.1 time: 0.099563 Oct 12 00:22:04.436102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 131/252] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:04 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:04.622434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8d7f99fe-0a16-4891-a3f3-e3955bec7597 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/action" status: 202 len: 0 microversion: 2.1 time: 0.311163 Oct 12 00:22:04.623076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 122/253] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:22:04 2022] POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:22:04.631741 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:04.632593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:04.640639 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:04.641128 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:04.641556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:04.642278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:04.642732 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:04.643330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:04.809984 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:04.821518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-404ffb4f-d88a-4fae-88d9-c04ef48234a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.193789 Oct 12 00:22:04.825737 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 132/254] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:04 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:04.934475 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a0888824-72a7-454b-b691-fcf31fb89aa9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'create', calling method: .version_select at 0x7f2fe90db3a0>, body: {"keypair": {"name": "tempest-keypair-491537022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBObEqkxBfryrj38PulaZZgxrwRm0nEPc7Gl1beDc/F1Z599qkY2bZUkavhQXpuJ+RVvv7h/jK+wLExqNTofGLrhM7Z0P4g7uskk2knVTki/0vjJ+Tu+J09SaNhDnu7fPog=="}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:04.949868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-a0888824-72a7-454b-b691-fcf31fb89aa9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Getting quotas for project 38c7ea1f3f9848b484a56cf74a2bd129. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:22:04.953656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-a0888824-72a7-454b-b691-fcf31fb89aa9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Getting quotas for user cdd87151f3af4a3bb1c3815db5d0e8fa and project 38c7ea1f3f9848b484a56cf74a2bd129. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:22:05.042275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a0888824-72a7-454b-b691-fcf31fb89aa9 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112636 Oct 12 00:22:05.042963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 123/255] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:22:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:05.461569 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:05.462108 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:05.470913 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:05.471942 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:05.472541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:05.473570 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:05.474168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:05.474732 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:05.576920 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:05.594141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-381a58e9-365e-4cfd-b28c-aca2d8cbe0b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1311 microversion: 2.1 time: 0.136383 Oct 12 00:22:05.596010 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 133/256] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:05 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:05.847026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:05.847706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:05.856419 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:05.857222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:05.858115 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:05.859265 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:05.860111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:05.860828 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:06.219621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:06.235184 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6e8a265d-89b7-44f2-929a-7539f3ec7336 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.391778 Oct 12 00:22:06.236447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 124/257] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:05 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:06.622569 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:06.623811 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:06.633111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:06.636040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:06.636500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:06.637245 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:06.638141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:06.638700 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:06.847969 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:06.855912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b2a9de52-b5f9-4f9e-b7fa-496fda3c9e18 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1367 microversion: 2.1 time: 0.241736 Oct 12 00:22:06.856488 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 134/258] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:06 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:07.259031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:07.260349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:07.269871 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:07.272375 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:07.274426 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:07.276526 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:07.280741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:07.281418 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:07.581398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:07.598151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3193165a-1189-41c1-b8f5-b016c8f5646a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.343354 Oct 12 00:22:07.612941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 125/259] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:07 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:07.818164 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-39e4435b-b40b-4404-b201-ea4be2567aa9 req-26690fba-bfb4-4df1-b039-af32d908936b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a75274-767b-4dd6-86bc-536d9a96b07b", "tag": "617aaa52-3f6e-495d-a0e1-b133ca5d63c3"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:07.833346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:07.847293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-39e4435b-b40b-4404-b201-ea4be2567aa9 req-26690fba-bfb4-4df1-b039-af32d908936b service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:07.847795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-39e4435b-b40b-4404-b201-ea4be2567aa9 req-26690fba-bfb4-4df1-b039-af32d908936b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:07.848217 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-39e4435b-b40b-4404-b201-ea4be2567aa9 req-26690fba-bfb4-4df1-b039-af32d908936b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:07.878856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:07.880484 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:07.884476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-39e4435b-b40b-4404-b201-ea4be2567aa9 req-26690fba-bfb4-4df1-b039-af32d908936b service nova] Creating event network-changed:617aaa52-3f6e-495d-a0e1-b133ca5d63c3 for instance 69a75274-767b-4dd6-86bc-536d9a96b07b on hv-cinder-84914 Oct 12 00:22:07.897688 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-39e4435b-b40b-4404-b201-ea4be2567aa9 req-26690fba-bfb4-4df1-b039-af32d908936b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080508 Oct 12 00:22:07.897688 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 135/260] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:07.901342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:07.901850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:07.903654 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:07.904447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:07.904896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:07.907631 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:08.223470 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:08.243342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-98c7c543-402d-4ac7-99ed-740e49e839bf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1367 microversion: 2.1 time: 0.367242 Oct 12 00:22:08.244811 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 126/261] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:07 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:08.625753 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:08.633503 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:08.646394 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:08.647337 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:08.648542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:08.649966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:08.650892 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:08.652184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:08.701173 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:09.001638 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35c8322e-88f2-4384-8597-f6edec014576", "device": "/dev/sdb"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:09.005286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:09.008377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:09.018075 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:09.019052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:09.020325 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:09.028408 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:09.028408 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:09.028408 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:09.151652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:09.162210 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9ac4e928-b405-44c7-9afd-411800e8f330 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.543644 Oct 12 00:22:09.162898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 136/262] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:08 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:09.269369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:09.269988 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:09.277824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:09.278314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:09.278747 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:09.279486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:09.279943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:09.280356 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:09.284864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:09.671347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:09.684941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9503eb06-17ef-48be-b7c0-0cdbf64c0ab6 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1367 microversion: 2.1 time: 0.422594 Oct 12 00:22:09.685659 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 137/263] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:09 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:09.825423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-490844327", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "973be902-a368-4ae5-bb3f-30b2cbc52bd3"}], "security_groups": [{"name": "tempest-securitygroup--1649857051"}], "key_name": "tempest-keypair-491537022", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:10.045445 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] validate_networks() for [('973be902-a368-4ae5-bb3f-30b2cbc52bd3', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:22:10.693400 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:22:10.693959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:22:10.694311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:22:10.694719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:22:10.695129 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:22:10.704771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:10.705270 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:10.705676 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:10.706388 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:10.706835 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:10.707264 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:10.724340 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Getting quotas for project 38c7ea1f3f9848b484a56cf74a2bd129. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:22:10.728282 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Getting quotas for user cdd87151f3af4a3bb1c3815db5d0e8fa and project 38c7ea1f3f9848b484a56cf74a2bd129. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:22:10.739275 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:22:10.741606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:22:10.845716 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3800356f-054c-4583-b216-060585d9f2f3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.024458 Oct 12 00:22:10.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 138/264] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:22:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 00:22:10.850835 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:10.851549 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:10.857583 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:10.858098 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:10.858535 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:10.859232 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:10.859710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:10.860140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:11.006980 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b901faec-9721-4dce-a706-0811ec2af760 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "POST /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.009370 Oct 12 00:22:11.008792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 127/265] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:22:08 2022] POST /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9/os-volume_attachments => generated 194 bytes in 2012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:11.018100 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:11.018802 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:11.025390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:11.026278 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:11.026873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:11.027777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:11.028507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:11.029209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:11.081036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:11.097011 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1e734766-1b14-4297-84d4-b83345b8d0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.249561 Oct 12 00:22:11.099679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 139/266] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:10 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:11.114599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aa7f4808-cce8-4c9d-abc1-78a6ce48ffbc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:11.115863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aa7f4808-cce8-4c9d-abc1-78a6ce48ffbc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:11.172581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aa7f4808-cce8-4c9d-abc1-78a6ce48ffbc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:11.181125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aa7f4808-cce8-4c9d-abc1-78a6ce48ffbc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1244 microversion: 2.1 time: 0.071728 Oct 12 00:22:11.183215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 140/267] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:11 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:11.194450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:11.205439 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a03b749b-626e-4159-84bf-43306f7eadca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1367 microversion: 2.1 time: 0.194817 Oct 12 00:22:11.206525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 128/268] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:11 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:12.125700 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:12.127119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:12.136167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:12.144030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:12.144030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:12.144030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:12.144030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:12.144355 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:12.210031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:12.212373 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:12.221941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:12.223004 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:12.223953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:12.225280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:12.226762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:12.227336 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:12.336447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:12.349740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8c77f56b-5fff-4767-8290-1dbfa629648f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1248 microversion: 2.1 time: 0.145652 Oct 12 00:22:12.367465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 129/269] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:12 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1248 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:12.373182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:12.375050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:12.380348 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:12.381107 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:12.381547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:12.382258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:12.382708 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:12.383131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:12.537588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:12.541146 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:12.557178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-83ea9a68-32cf-40be-8bfc-06e6e1725e96 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.436822 Oct 12 00:22:12.560992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 141/270] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:12 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:12.561186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9b406f5f-fc85-45cb-a158-b1017f4660a4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1367 microversion: 2.1 time: 0.192139 Oct 12 00:22:12.562063 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 130/271] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:12 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:13.379385 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:13.380034 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:13.387793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:13.388285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:13.388730 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:13.389423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:13.389875 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:13.390300 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:13.469843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:13.478554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3ad5d07f-2a1f-4e83-8448-b210fdb080bc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1296 microversion: 2.1 time: 0.109376 Oct 12 00:22:13.479462 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 142/272] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:13 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1296 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:13.581140 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:13.582600 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:13.585765 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:13.586074 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:13.589343 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:13.590052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:13.590651 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:13.591540 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:13.592163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:13.592360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:13.592747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:13.593369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:13.594582 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:13.595545 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:13.596600 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:13.597190 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:13.780687 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:13.791018 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-893656d2-7f7a-4d24-8814-f582b3d8c795 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.213744 Oct 12 00:22:13.791649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 131/273] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:13 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:13.841906 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:13.850087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6534a462-4693-49e8-8f80-789cd81c163b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1367 microversion: 2.1 time: 0.269140 Oct 12 00:22:13.851010 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 143/274] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:13 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:14.470004 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-b72ccd65-5b95-45ad-9876-34d2aae0ac3b req-ef24b97f-a76e-4b16-a128-90c5c55f2584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a75274-767b-4dd6-86bc-536d9a96b07b", "name": "network-vif-plugged", "status": "completed", "tag": "617aaa52-3f6e-495d-a0e1-b133ca5d63c3"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:14.499251 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-b72ccd65-5b95-45ad-9876-34d2aae0ac3b req-ef24b97f-a76e-4b16-a128-90c5c55f2584 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:14.499808 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-b72ccd65-5b95-45ad-9876-34d2aae0ac3b req-ef24b97f-a76e-4b16-a128-90c5c55f2584 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:14.500245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-b72ccd65-5b95-45ad-9876-34d2aae0ac3b req-ef24b97f-a76e-4b16-a128-90c5c55f2584 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:14.502938 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:14.503795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:14.513505 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:14.514273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:14.514993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-b72ccd65-5b95-45ad-9876-34d2aae0ac3b req-ef24b97f-a76e-4b16-a128-90c5c55f2584 service nova] Creating event network-vif-plugged:617aaa52-3f6e-495d-a0e1-b133ca5d63c3 for instance 69a75274-767b-4dd6-86bc-536d9a96b07b on hv-cinder-84914 Oct 12 00:22:14.515147 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:14.520141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-b72ccd65-5b95-45ad-9876-34d2aae0ac3b req-ef24b97f-a76e-4b16-a128-90c5c55f2584 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070667 Oct 12 00:22:14.520279 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:14.520655 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:14.521179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:14.523860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 132/275] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:14.617572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:14.645593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1e8756fb-3bb2-4172-88c6-afcd2c7607a1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1302 microversion: 2.1 time: 0.147320 Oct 12 00:22:14.648134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 144/276] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:14 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1302 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:14.817748 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:14.821237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:14.830192 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:14.830680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:14.831114 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:14.832845 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:14.835360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:14.836431 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:14.874776 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:14.875713 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:14.886211 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:14.888256 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:14.888974 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:14.889737 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:14.896467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:14.897616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:14.898222 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:14.960366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=10 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:15.211874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:15.216197 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:15.222905 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2be7b05d-8d0d-4ab6-a513-ac3c3f0c9f9e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.409738 Oct 12 00:22:15.224027 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 133/277] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:14 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:15.228546 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8cff8027-010d-4773-b96e-e985daa5face tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1367 microversion: 2.1 time: 0.358358 Oct 12 00:22:15.229347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 145/278] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:14 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:15.675167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:15.675731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:15.687576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:15.688724 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:15.689377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:15.690306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:15.691089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:15.691898 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:15.964655 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:15.977212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f27e4d93-89d2-4a90-81dd-a6d9c136fdfa tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.305874 Oct 12 00:22:15.978079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 134/279] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:15 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:16.243155 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-6ea9a863-904c-4a91-9efe-08b473b8d863 req-b6a375b9-9bed-4721-9e90-3f17d2b93f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8894cbf9-861b-4b92-90ee-00bbe2777303", "tag": "9df6017e-afa4-4f72-91b3-79f5fe5d9b49"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:16.259853 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:16.260886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:16.275060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6ea9a863-904c-4a91-9efe-08b473b8d863 req-b6a375b9-9bed-4721-9e90-3f17d2b93f16 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:16.278474 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:16.278595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6ea9a863-904c-4a91-9efe-08b473b8d863 req-b6a375b9-9bed-4721-9e90-3f17d2b93f16 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:16.278681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:16.278681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:16.278838 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6ea9a863-904c-4a91-9efe-08b473b8d863 req-b6a375b9-9bed-4721-9e90-3f17d2b93f16 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:16.279228 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:16.279911 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:16.281291 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:16.310004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-6ea9a863-904c-4a91-9efe-08b473b8d863 req-b6a375b9-9bed-4721-9e90-3f17d2b93f16 service nova] Creating event network-changed:9df6017e-afa4-4f72-91b3-79f5fe5d9b49 for instance 8894cbf9-861b-4b92-90ee-00bbe2777303 on hv-cinder-84914 Oct 12 00:22:16.318060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-6ea9a863-904c-4a91-9efe-08b473b8d863 req-b6a375b9-9bed-4721-9e90-3f17d2b93f16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080145 Oct 12 00:22:16.319649 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 146/280] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:16.325785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:16.326478 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:16.333519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:16.334378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:16.335013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:16.335894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:16.336347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:16.336764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:16.523478 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:16.537966 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-cd01184f-794e-459e-8028-1cc251adb9e4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.295222 Oct 12 00:22:16.557157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 135/281] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:16 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:16.625689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:16.639432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-39375778-7dde-4df5-961e-eafe444f1f56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1367 microversion: 2.1 time: 0.318374 Oct 12 00:22:16.641148 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 147/282] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:16 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:17.001646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:17.002419 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:17.009912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:17.010769 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:17.011540 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:17.012740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:17.013399 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:17.014028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:17.174984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:17.186731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4a3f34cf-1073-4fe6-9a50-f3182fcc6333 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.188840 Oct 12 00:22:17.189506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 136/283] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:16 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:17.565136 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:17.566421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:17.577489 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:17.579203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:17.579203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:17.588277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:17.588802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:17.589233 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:17.662465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:17.663385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:17.676132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:17.676541 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:17.676982 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:17.677701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:17.678157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:17.678577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:17.840427 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:17.845735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:17.855354 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a1d12e10-f354-4dfb-abc5-c304c354a0a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1557 microversion: 2.1 time: 0.196647 Oct 12 00:22:17.858595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 137/284] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:17 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1557 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:17.875622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d26372b0-2300-461f-9597-4dedd56391e5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.313977 Oct 12 00:22:17.876841 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 148/285] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:17 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:17.880724 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:17.881331 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:17.888177 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:17.888874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:17.889474 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:17.890329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:17.891081 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:17.891734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:18.021335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b1cd1fb1-b73b-43ab-8b85-86df0593f9f4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144937 Oct 12 00:22:18.022532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 138/286] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Oct 12 00:22:17 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:18.234058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:18.234397 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:18.242252 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:18.242601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:18.244261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:18.245207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:18.245851 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:18.246422 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:18.387199 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:18.395791 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-09c842f8-7c92-4365-bca5-88a62ffbeb83 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.187224 Oct 12 00:22:18.396574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 149/287] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:18 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:18.898212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:18.899110 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:18.913259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:18.915573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:18.916289 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:18.924217 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:18.926960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:18.927692 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:19.265081 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:19.281055 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2ece7de6-4907-4d83-98e6-de758304f6ad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.386783 Oct 12 00:22:19.281762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 139/288] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:18 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:19.419432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:19.432922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:19.449111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:19.449782 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:19.451181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:19.451931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:19.452390 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:19.452814 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:19.640629 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:19.648230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-63bedd1c-6518-4587-9df0-10924b915e00 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.233976 Oct 12 00:22:19.663560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 150/289] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:19 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:19.796205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-fc3f6ce6-1e10-4c12-b321-f74a1c18b83e req-d20c6809-c720-4763-8ede-2c15e2ed62fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a75274-767b-4dd6-86bc-536d9a96b07b", "tag": "617aaa52-3f6e-495d-a0e1-b133ca5d63c3"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:19.813343 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-fc3f6ce6-1e10-4c12-b321-f74a1c18b83e req-d20c6809-c720-4763-8ede-2c15e2ed62fa service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:19.813831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-fc3f6ce6-1e10-4c12-b321-f74a1c18b83e req-d20c6809-c720-4763-8ede-2c15e2ed62fa service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:19.814263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-fc3f6ce6-1e10-4c12-b321-f74a1c18b83e req-d20c6809-c720-4763-8ede-2c15e2ed62fa service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:19.845943 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-fc3f6ce6-1e10-4c12-b321-f74a1c18b83e req-d20c6809-c720-4763-8ede-2c15e2ed62fa service nova] Creating event network-changed:617aaa52-3f6e-495d-a0e1-b133ca5d63c3 for instance 69a75274-767b-4dd6-86bc-536d9a96b07b on hv-cinder-84914 Oct 12 00:22:19.857842 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-fc3f6ce6-1e10-4c12-b321-f74a1c18b83e req-d20c6809-c720-4763-8ede-2c15e2ed62fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065109 Oct 12 00:22:19.860087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 140/290] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:22:20.305998 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:20.306896 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:20.314033 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:20.314661 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:20.315294 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:20.316027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:20.316665 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:20.317085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:20.531653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:20.556960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2fc802f6-8c4e-444c-9691-ef2c9515f9f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.254911 Oct 12 00:22:20.557855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 151/291] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:20 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:20.673750 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:20.675304 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:20.682996 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:20.683834 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:20.684426 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:20.685432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:20.686119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:20.686730 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:20.845479 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:20.856008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ce9e774c-1204-4db7-ae12-13f218b43ed0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.186829 Oct 12 00:22:20.857121 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 141/292] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:20 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:21.583671 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:21.583671 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:21.584686 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:21.585841 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=8 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:21.590068 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:21.590877 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:21.591464 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:21.592386 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:21.593042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:21.593757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:21.750720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:21.759621 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-14e94c36-a55f-4a46-b6f1-03f730b2d001 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.183378 Oct 12 00:22:21.760181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 152/293] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:21 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:21.879107 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:21.879841 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:21.886821 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:21.887589 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:21.888030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:21.888741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:21.889195 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:21.894132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:22.038413 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:22.047049 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d61f42cf-4075-4239-a6a3-6d63b458ffa5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.171972 Oct 12 00:22:22.047674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 142/294] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:21 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:22.783755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:22.785115 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:22.791822 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:22.792553 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:22.793096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:22.793806 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:22.794322 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:22.794803 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:22.941079 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:22.950364 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-84a6a15c-67b0-404f-8cf3-5a8d54daab6d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.170987 Oct 12 00:22:22.965996 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 153/295] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:22 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:23.070270 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:23.071566 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:23.078395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:23.079065 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:23.079522 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:23.080393 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:23.081006 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:23.081528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:23.229332 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:23.238032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1b0796db-38a0-41fc-b3bc-0ba0577b56f4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.171761 Oct 12 00:22:23.238622 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 143/296] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:23 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:23.975930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:23.976614 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:23.990608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:23.991231 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:23.991755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:23.992526 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:23.993060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:23.994881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:24.236954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:24.249056 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-54e5558e-3c39-4e91-b9e4-3ead7d9c4a69 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.278065 Oct 12 00:22:24.263481 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:24.268179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 154/297] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:23 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:24.268305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:24.274048 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:24.274539 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:24.275193 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:24.276302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:24.276765 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:24.277373 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:24.443652 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:24.454605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-82600822-c562-4922-aa2d-7be445ee8d5f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.196097 Oct 12 00:22:24.455386 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 144/298] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:24 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:25.273306 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:25.287762 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:25.287762 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:25.287762 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:25.287762 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:25.288167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:25.288167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:25.288167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:25.473137 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:25.478146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:25.481831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:25.485750 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:25.486238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:25.486670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:25.487391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:25.487842 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:25.491493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:25.498475 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b139dbbd-51f5-4af1-b2ad-8b40dbab1e17 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.228989 Oct 12 00:22:25.499060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 155/299] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:25 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:25.653111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:25.662198 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e9e240d2-44fd-4480-a598-42010c0c3bcd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.187926 Oct 12 00:22:25.662834 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 145/300] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:25 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:26.523758 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:26.524391 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:26.530240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:26.530712 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:26.531168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:26.531874 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:26.532321 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:26.532734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:26.537641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:26.689581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:26.689581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2d2c7ed2-ac19-42a0-86fb-fd1c88e2ac9d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.150602 Oct 12 00:22:26.689581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 156/301] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:26 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:26.689917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:26.689917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:26.692959 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:26.693462 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:26.693882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:26.694561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:26.695004 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:26.695442 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:26.823656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:26.831220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4ff98c6f-e40c-49d5-b352-e81f6b7d37c3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.149709 Oct 12 00:22:26.831843 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 146/302] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:26 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:26.978291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-18d35fcb-f147-4c3f-9e23-037f8367a160 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Action: 'create', calling method: .version_select at 0x7f2fe9090160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1585632205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvrusnc4jSotOBoePNNp9GfcaPo92IMWqshuY3Smfo2Po3JQw9YTPDaGO4whH4ZjII5ltpgMK+32J+IgloUFwDlGmzfXt5kjflSZqASDjOEJK69UUjhb1QMcQsv7APmew=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:26.994148 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-18d35fcb-f147-4c3f-9e23-037f8367a160 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Getting quotas for project 33e38693dbe5490fb39cd1981274a5f6. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:22:26.998609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-18d35fcb-f147-4c3f-9e23-037f8367a160 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Getting quotas for user 1c38342973094c43b412fff9e0f460d6 and project 33e38693dbe5490fb39cd1981274a5f6. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:22:27.077184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-18d35fcb-f147-4c3f-9e23-037f8367a160 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.102682 Oct 12 00:22:27.077768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 157/303] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:22:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:27.129742 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-826498745", "imageRef": "df03ab57-5038-4de4-a1f9-1c9d43d1cdaf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1585632205", "networks": [{"uuid": "dd5abad8-644b-4096-9887-e4113519a575"}]}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:27.183000 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] validate_networks() for [('dd5abad8-644b-4096-9887-e4113519a575', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:22:27.544203 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:22:27.549873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:22:27.549873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:22:27.549873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:22:27.549873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:22:27.554755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:27.555225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:27.555684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:27.556403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:27.556842 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:27.557325 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:27.574122 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Getting quotas for project 33e38693dbe5490fb39cd1981274a5f6. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:22:27.578062 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Getting quotas for user 1c38342973094c43b412fff9e0f460d6 and project 33e38693dbe5490fb39cd1981274a5f6. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:22:27.589549 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:22:27.591814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='df03ab57-5038-4de4-a1f9-1c9d43d1cdaf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:22:27.694014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:27.694623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:27.700602 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:27.701097 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:27.701524 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:27.702204 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:27.702651 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:27.703065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:27.715086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-24787b0e-9beb-4ec9-a891-b00123072cd6 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589259 Oct 12 00:22:27.716506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 147/304] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:22:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:22:27.727590 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-992369af-0637-498a-a896-e1925a275fdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:27.728205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-992369af-0637-498a-a896-e1925a275fdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:27.731199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:27.789372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-992369af-0637-498a-a896-e1925a275fdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:27.797711 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-992369af-0637-498a-a896-e1925a275fdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1258 microversion: 2.1 time: 0.073925 Oct 12 00:22:27.798350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 148/305] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:27 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:27.852071 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:27.857081 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:27.857768 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:27.862308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5e982a77-1016-4934-aeef-b08616ecd302 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.172177 Oct 12 00:22:27.863278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 158/306] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:27 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:27.864293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:27.864817 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:27.865393 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:27.866101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:27.866554 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:27.866982 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:27.997012 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:28.005326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-102bf9d1-2664-43ed-9734-77a6b8600ea6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.152554 Oct 12 00:22:28.006999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 149/307] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:27 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:28.820636 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-38ef5f26-bd93-4b11-a28c-f90b18c90f63 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:28.821838 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-38ef5f26-bd93-4b11-a28c-f90b18c90f63 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:28.850617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-1dd4c1c9-9f37-473c-b098-fd49f5c784b1 req-86b934bd-339d-4424-aa63-7970971279f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8894cbf9-861b-4b92-90ee-00bbe2777303", "name": "network-vif-plugged", "status": "completed", "tag": "9df6017e-afa4-4f72-91b3-79f5fe5d9b49"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:28.864288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1dd4c1c9-9f37-473c-b098-fd49f5c784b1 req-86b934bd-339d-4424-aa63-7970971279f8 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:28.864825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1dd4c1c9-9f37-473c-b098-fd49f5c784b1 req-86b934bd-339d-4424-aa63-7970971279f8 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:28.865250 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1dd4c1c9-9f37-473c-b098-fd49f5c784b1 req-86b934bd-339d-4424-aa63-7970971279f8 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:28.876838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-1dd4c1c9-9f37-473c-b098-fd49f5c784b1 req-86b934bd-339d-4424-aa63-7970971279f8 service nova] Creating event network-vif-plugged:9df6017e-afa4-4f72-91b3-79f5fe5d9b49 for instance 8894cbf9-861b-4b92-90ee-00bbe2777303 on hv-cinder-84914 Oct 12 00:22:28.883576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-1dd4c1c9-9f37-473c-b098-fd49f5c784b1 req-86b934bd-339d-4424-aa63-7970971279f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034856 Oct 12 00:22:28.883576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 150/308] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:22:28.885458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-38ef5f26-bd93-4b11-a28c-f90b18c90f63 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:28.887743 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:28.888414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:28.892954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-38ef5f26-bd93-4b11-a28c-f90b18c90f63 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1258 microversion: 2.1 time: 0.076212 Oct 12 00:22:28.893512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 159/309] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:28 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:28.894395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:28.894871 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:28.895295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:28.896006 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:28.896452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:28.896866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:29.028612 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:29.029525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:29.031747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:29.038461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:29.038461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:29.038461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:29.038461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:29.038831 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:29.038831 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:29.040058 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8b2619e9-19b5-4235-ada6-f072e7504365 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.156522 Oct 12 00:22:29.040633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 151/310] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:28 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:29.169795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:29.177723 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4fac17d7-b9e0-4444-ba86-1155f0749ae7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.153366 Oct 12 00:22:29.178285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 160/311] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:29 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:29.915736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:29.916341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:29.922582 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:29.923052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:29.923712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:29.924181 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:29.924624 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:29.925042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:29.988261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:29.996318 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c3518c42-00e0-45d1-bc82-0c98deb1c6bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1310 microversion: 2.1 time: 0.084478 Oct 12 00:22:29.996875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 152/312] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:29 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:30.063114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:30.063757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:30.069816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:30.070291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:30.070744 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:30.071437 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:30.071890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:30.072313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:30.199046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:30.207943 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:30.207943 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:30.208163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0ebc3157-2cb9-4ad0-895b-55bcec158fc8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.147933 Oct 12 00:22:30.208163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 161/313] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:30 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:30.208335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:30.208335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:30.208746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:30.209436 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:30.209886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:30.210309 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:30.228338 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=100 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:30.337594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:30.345219 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5e5a18e9-2a8b-40af-9840-a7391597f865 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.148220 Oct 12 00:22:30.345781 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 153/314] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:30 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:31.019934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:31.020540 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:31.026996 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:31.027501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:31.027937 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:31.028619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:31.029070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:31.029490 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:31.087823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:31.095816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-03a3e039-2356-4424-930c-15221f2b9304 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1310 microversion: 2.1 time: 0.079689 Oct 12 00:22:31.096380 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 162/315] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:31 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:31.230188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:31.230794 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:31.237271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:31.237749 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:31.238187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:31.238877 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:31.239329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:31.239775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:31.365972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:31.368540 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:31.369143 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:31.374365 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-041f758c-c79d-4cc4-87fc-774824d8c5c0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.147986 Oct 12 00:22:31.374928 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 154/316] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:31 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:31.375059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:31.375470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:31.375955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:31.376649 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:31.377102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:31.377524 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:31.706711 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:31.714260 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-16355a89-0c8c-4b9f-9fd6-53b125b35a0d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.349539 Oct 12 00:22:31.714816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 163/317] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:31 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:32.118926 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:32.120235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:32.126176 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:32.126645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:32.127071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:32.127774 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:32.128217 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:32.128636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:32.191339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:32.198958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4cab903f-8e5e-41f4-94a3-60f6c1ac31d8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1310 microversion: 2.1 time: 0.083874 Oct 12 00:22:32.199561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 155/318] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:32 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:32.398045 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:32.398577 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:32.405078 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:32.405549 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:32.405974 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:32.406652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:32.407102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:32.407546 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:32.532196 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:32.540393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-add7ce0f-8d91-49f9-833d-a7fb4a264426 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.146296 Oct 12 00:22:32.541811 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 164/319] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:32 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:32.736513 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:32.737119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:32.743557 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:32.744038 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:32.744470 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:32.745152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:32.745601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:32.746020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:32.871783 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:32.879540 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6224acd5-3bf8-4781-8e53-8bf6cfb3332d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1370 microversion: 2.1 time: 0.146778 Oct 12 00:22:32.880102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 156/320] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:32 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:33.221153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:33.223498 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:33.229677 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:33.230168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:33.230599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:33.231300 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:33.231821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:33.232243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:33.293852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:33.301507 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f1fd11f5-2b17-46c2-bb59-96a9b16c5cf8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1310 microversion: 2.1 time: 0.084251 Oct 12 00:22:33.302067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 165/321] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:33 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:33.564112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:33.564713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:33.570784 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:33.571290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:33.571746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:33.572452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:33.572932 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:33.573373 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:33.702288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:33.710677 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ecad66f1-58a3-4655-a99c-c17a2363acbd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.150532 Oct 12 00:22:33.711248 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 157/322] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:33 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:33.902921 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:33.903566 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:33.909468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:33.909941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:33.910372 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:33.911057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:33.911535 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:33.911960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:34.041965 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:34.049673 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b401ef70-4f55-4107-b667-2d948e6b734e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1565 microversion: 2.1 time: 0.151172 Oct 12 00:22:34.050234 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 166/323] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:33 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:34.077776 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:34.077776 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:34.078402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:34.078884 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:34.079317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:34.080026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:34.080478 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:34.080900 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:34.160600 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5a5b6490-3ba5-47c3-a308-451bf9905ebf tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092903 Oct 12 00:22:34.161199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 158/324] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Oct 12 00:22:34 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:34.325474 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:34.326176 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:34.332343 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:34.333040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:34.333668 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:34.334538 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:34.334993 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:34.335440 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:34.402826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:34.410842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2366fa58-0151-47a8-b9b3-aaa43d820f51 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1310 microversion: 2.1 time: 0.089874 Oct 12 00:22:34.411648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 167/325] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:34 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:34.734131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:34.734740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:34.740839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:34.743514 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:34.743514 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:34.743514 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:34.743514 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:34.743866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:35.207799 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:35.217929 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b3f3fcbf-aa64-4672-ad4e-dd0664fe2101 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1722 microversion: 2.1 time: 0.487671 Oct 12 00:22:35.218824 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 159/326] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:34 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1722 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:35.433994 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:35.434684 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:35.454407 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:35.455117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:35.455586 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:35.456319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:35.456756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:35.459671 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:35.484188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-1bb59c66-511b-49de-abd8-7350fd211a21 req-f3a0224a-3314-4ada-a8b4-e3f1f4f13840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8894cbf9-861b-4b92-90ee-00bbe2777303", "tag": "9df6017e-afa4-4f72-91b3-79f5fe5d9b49"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:35.494817 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1bb59c66-511b-49de-abd8-7350fd211a21 req-f3a0224a-3314-4ada-a8b4-e3f1f4f13840 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:35.495295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1bb59c66-511b-49de-abd8-7350fd211a21 req-f3a0224a-3314-4ada-a8b4-e3f1f4f13840 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:35.495963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1bb59c66-511b-49de-abd8-7350fd211a21 req-f3a0224a-3314-4ada-a8b4-e3f1f4f13840 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:35.513904 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-1bb59c66-511b-49de-abd8-7350fd211a21 req-f3a0224a-3314-4ada-a8b4-e3f1f4f13840 service nova] Creating event network-changed:9df6017e-afa4-4f72-91b3-79f5fe5d9b49 for instance 8894cbf9-861b-4b92-90ee-00bbe2777303 on hv-cinder-84914 Oct 12 00:22:35.519051 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-1bb59c66-511b-49de-abd8-7350fd211a21 req-f3a0224a-3314-4ada-a8b4-e3f1f4f13840 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038451 Oct 12 00:22:35.522777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 160/327] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:22:35.557496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:35.565940 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-266c70f4-1a57-4f4a-84f7-e9dc4a417eaa tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1328 microversion: 2.1 time: 0.135823 Oct 12 00:22:35.566799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 168/328] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:35 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1328 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:36.248125 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:36.249932 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:36.271913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:36.273055 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:36.274435 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:36.275881 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:36.276594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:36.278236 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:36.591554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:36.592504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:36.603789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:36.608096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:36.610668 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:36.611211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:36.612062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:36.612625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:36.615805 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:36.622206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f5f6da72-a21a-40d8-8615-03178ca070f8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1699 microversion: 2.1 time: 0.383279 Oct 12 00:22:36.636763 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 161/329] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:36 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1699 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:36.649272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-43475a69-35f5-49e1-810a-04e0f0821616 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:36.656547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43475a69-35f5-49e1-810a-04e0f0821616 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:36.667735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43475a69-35f5-49e1-810a-04e0f0821616 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:36.667735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43475a69-35f5-49e1-810a-04e0f0821616 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:36.687993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-43475a69-35f5-49e1-810a-04e0f0821616 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Going to try to start instance {{(pid=125809) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 00:22:36.900636 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:36.909562 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1498a25d-32cc-4987-983d-2f7b901755b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.323166 Oct 12 00:22:36.912811 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 169/330] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:36 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:36.917747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-43475a69-35f5-49e1-810a-04e0f0821616 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/action" status: 202 len: 0 microversion: 2.1 time: 0.273238 Oct 12 00:22:36.921922 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 162/331] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:22:36 2022] POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 00:22:36.930691 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:36.932366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:36.939519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:36.941309 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:36.942046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:36.942916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:36.943842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:36.944771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:36.945416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:37.256550 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:37.269249 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-83bfc51e-aebd-45f4-a25f-d8c9586abab0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.343203 Oct 12 00:22:37.288081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 170/332] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:36 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:37.296777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:37.297516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:37.307056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:37.310450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:37.310450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:37.310450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:37.310450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:37.310866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:37.471141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lazy-loading 'services' on Instance uuid 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:22:37.541255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-b9e23f28-718a-4b9a-9adb-c3de13ce90a4 req-234d659d-349f-4baf-920f-202cbae89a15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d008f88e-de37-4b22-b411-7a5de1fef288", "tag": "286053d8-514a-44bb-93e8-8591874205f2"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:37.557174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b9e23f28-718a-4b9a-9adb-c3de13ce90a4 req-234d659d-349f-4baf-920f-202cbae89a15 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:37.557567 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b9e23f28-718a-4b9a-9adb-c3de13ce90a4 req-234d659d-349f-4baf-920f-202cbae89a15 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:37.558012 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b9e23f28-718a-4b9a-9adb-c3de13ce90a4 req-234d659d-349f-4baf-920f-202cbae89a15 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:37.565194 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:37.586708 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-b9e23f28-718a-4b9a-9adb-c3de13ce90a4 req-234d659d-349f-4baf-920f-202cbae89a15 service nova] Creating event network-changed:286053d8-514a-44bb-93e8-8591874205f2 for instance d008f88e-de37-4b22-b411-7a5de1fef288 on hv-cinder-84914 Oct 12 00:22:37.598863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-b9e23f28-718a-4b9a-9adb-c3de13ce90a4 req-234d659d-349f-4baf-920f-202cbae89a15 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061153 Oct 12 00:22:37.599584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 171/333] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:22:37.770052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7dcaed38-22d8-4986-a5f9-ad04982c9ffc tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9/os-volume_attachments/35c8322e-88f2-4384-8597-f6edec014576" status: 202 len: 0 microversion: 2.1 time: 0.479151 Oct 12 00:22:37.770683 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 163/334] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:22:37 2022] DELETE /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9/os-volume_attachments/35c8322e-88f2-4384-8597-f6edec014576 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 00:22:37.937606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:37.938255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:37.946105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:37.946687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:37.947617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:37.948320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:37.948766 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:37.949193 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:38.091858 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:38.100367 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-79a85593-2f73-4619-8d11-36a2c8567136 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.167197 Oct 12 00:22:38.114502 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 172/335] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:37 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:38.293695 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=8 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:38.298376 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:38.299097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:38.305601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:38.399310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:38.399310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:38.399310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:38.399310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:38.400949 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:38.468793 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:38.485279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a0ebc688-1eab-4dc7-95bb-6a2192ab8d37 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.192487 Oct 12 00:22:38.486065 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 164/336] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:38 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:39.125668 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:39.126343 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:39.129470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:39.133046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:39.133533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:39.134160 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:39.135527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:39.135984 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:39.136417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:39.272327 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:39.280062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d5c8b4f0-d714-43b3-a3b6-b2eeeea9c8ad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.158855 Oct 12 00:22:39.280633 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 173/337] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:39 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:39.508861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:39.509661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:39.517453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:39.518016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:39.518513 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:39.520039 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:39.520755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:39.521419 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:39.666899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:39.676689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bfdc5e1d-b497-468b-a539-f485fc2359b8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.171871 Oct 12 00:22:39.677259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 165/338] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:39 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:40.302299 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:40.303249 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:40.309567 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:40.310040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:40.310467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:40.311140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:40.311619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:40.312038 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:40.448998 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:40.457081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-763ba922-800b-47e7-b7e9-9d4654755b22 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.158696 Oct 12 00:22:40.457854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 174/339] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:40 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:40.702487 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:40.703097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:40.709542 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:40.710020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:40.710452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:40.711139 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:40.711643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:40.712072 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:40.848750 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:40.858241 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-eb3990ec-1cf7-4935-a308-f725f2b71c6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.159524 Oct 12 00:22:40.863401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 166/340] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:40 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:41.480777 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:41.481542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:41.487741 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:41.488172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:41.488605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:41.489306 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:41.489756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:41.490180 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:41.509140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:41.627853 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:41.636403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4a0c0e47-e91a-4f8a-81eb-7733c26758e4 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.159320 Oct 12 00:22:41.652644 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 175/341] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:41 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:41.882672 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:41.883286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:41.890329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:41.890912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:41.891461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:41.892267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:41.892785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:41.893272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:42.035212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:42.044461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5ce7dc7f-e5a4-4c52-bf45-4f3010a7cb7a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.165789 Oct 12 00:22:42.045492 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 167/342] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:41 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:42.659500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:42.660127 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:42.666036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:42.666515 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:42.666988 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:42.667709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:42.668164 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:42.668585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:42.808730 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:42.817038 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-37704306-8ce1-4a1e-a956-2c987418c5be tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.161424 Oct 12 00:22:42.817823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 176/343] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:42 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:43.068308 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:43.068832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:43.075986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:43.076471 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:43.076905 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:43.077607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:43.078064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:43.078481 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:43.222539 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:43.233739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7c57c86a-af1d-4a3c-898d-afd8d3edadfa tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.169164 Oct 12 00:22:43.243415 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 168/344] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:43 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:43.841091 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:43.841714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:43.847997 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:43.848488 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:43.848930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:43.849635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:43.850087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:43.850511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:43.998041 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:44.005922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-94824faf-e1b7-40fc-bafe-4074ec407d8b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.169380 Oct 12 00:22:44.006485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 177/345] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:43 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:44.258736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:44.259335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:44.266290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:44.266806 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:44.267254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:44.267978 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:44.268466 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:44.268926 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:44.290247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:44.411452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:44.420292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-72da70f9-7228-4f32-9d30-cb3a87342f6a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.165331 Oct 12 00:22:44.420918 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 169/346] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:44 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:45.029994 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:45.030538 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:45.036500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:45.036979 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:45.037420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:45.038102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:45.038552 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:45.038971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:45.163532 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:45.171748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-36f35b0a-b8cf-4cc7-aa87-4e5c5d2e3d50 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.146200 Oct 12 00:22:45.172303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 178/347] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:45 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:45.444741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:45.445875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:45.452978 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:45.453451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:45.453876 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:45.454560 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:45.455003 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:45.455454 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:45.619861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:45.628160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c98ebe28-68e8-491b-a154-df49ea3dadf2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.187406 Oct 12 00:22:45.628723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 170/348] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:45 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:46.194291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:46.194898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:46.200814 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:46.201289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:46.201715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:46.202404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:46.202853 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:46.203270 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:46.377690 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:46.385813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ab7b8541-8729-4376-8d4b-65dfd828f0bb tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.195281 Oct 12 00:22:46.386722 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 179/349] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:46 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:46.651918 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:46.652570 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:46.659160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:46.659676 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:46.660115 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:46.660809 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:46.661284 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:46.661755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:46.799343 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:46.808075 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-39108b34-34ef-461c-852f-c40993d22298 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.160595 Oct 12 00:22:46.808745 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 171/350] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:46 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:47.408068 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:47.408683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:47.414600 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:47.415084 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:47.415559 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:47.416251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:47.416698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:47.417126 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:47.420326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:47.420820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:47.426759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:47.427237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:47.427711 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:47.428424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:47.428875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:47.429298 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:47.454718 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:22:47.545311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:47.552925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-954aa21e-ce5d-4968-9bdb-0938af3d2690 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.148619 Oct 12 00:22:47.553484 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 180/351] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:47 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:47.830638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:47.831560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:47.837294 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:47.837772 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:47.838201 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:47.838882 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:47.839332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:47.839779 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:47.846531 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5bb0492c-1c6b-4252-9eeb-ad445da5ad2e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 204 len: 0 microversion: 2.1 time: 0.429762 Oct 12 00:22:47.847980 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 172/352] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:22:47 2022] DELETE /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 00:22:47.856552 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:47.857447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:47.863614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:47.864098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:47.864530 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:47.865220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:47.865669 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:47.866094 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:47.971946 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:47.981028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f84e08ec-de5a-4563-becb-c3945e029a9f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1708 microversion: 2.1 time: 0.154172 Oct 12 00:22:47.981610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 181/353] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:47 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:47.998434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:48.006116 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c5ad85e4-6ecb-4a60-86bc-af2f222cd1d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1514 microversion: 2.1 time: 0.154043 Oct 12 00:22:48.006673 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 173/354] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:47 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:48.576739 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:48.577351 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:48.583451 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:48.587053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:48.587053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:48.587053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:48.587053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:48.587500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:48.716071 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:48.723691 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f578d34a-9a6a-4296-b3f9-97767672151e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.151227 Oct 12 00:22:48.724256 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 182/355] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:48 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:49.004133 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:49.004728 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:49.012108 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:49.012593 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:49.013029 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:49.013712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:49.014166 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:49.014589 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:49.029308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:49.029916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:49.035852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:49.036330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:49.036761 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:49.037443 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:49.037925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:49.038347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:49.143459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:49.151670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1a8570aa-6b27-4d43-a976-8864fb856758 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1712 microversion: 2.1 time: 0.151366 Oct 12 00:22:49.152243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 174/356] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:48 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:49.165755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:49.173934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-786d33a6-c70f-4a4c-a476-d1b306a7a733 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1514 microversion: 2.1 time: 0.148423 Oct 12 00:22:49.174485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 183/357] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:49 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:22:49.746047 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:49.746599 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:49.752747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:49.753225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:49.753659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:49.754340 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:49.754790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:49.755211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:49.883353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:49.891640 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ed425c66-1ab9-4921-b873-97304eb6911d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.149523 Oct 12 00:22:49.892203 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 175/358] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:49 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:50.197882 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:50.198516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:50.204433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:50.204910 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:50.205335 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:50.206013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:50.206458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:50.206872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:50.335115 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:50.342751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9a7c2345-2106-4fff-80fd-486354064aa7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1514 microversion: 2.1 time: 0.149251 Oct 12 00:22:50.343311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 184/359] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:50 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:50.914532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:50.915160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:50.922147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:50.922618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:50.923049 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:50.923754 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:50.924204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:50.924624 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:51.051709 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:51.059336 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-786ea2ef-1fb9-4c90-b0e2-f3873e91863f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.148648 Oct 12 00:22:51.059942 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 176/360] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:50 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:51.364949 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:51.365556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:51.371480 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:51.371968 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:51.372400 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:51.373078 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:51.373531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:51.373946 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:51.500509 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:51.508081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-900e35ff-77d6-4492-bbed-bdc0a4fb5c0c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1514 microversion: 2.1 time: 0.146981 Oct 12 00:22:51.508640 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 185/361] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:51 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:52.081924 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:52.082531 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:52.088990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:52.089463 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:52.089891 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:52.090568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:52.091024 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:52.091473 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:52.221630 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:52.229726 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f6a16d5e-0503-470d-8996-f266a1f258b8 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.151668 Oct 12 00:22:52.230396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 177/362] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:52 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:52.532269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:52.532833 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:52.538710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:52.539190 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:52.539652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:52.540338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:52.540828 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:52.541775 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:52.668243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:52.675922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bb2fb1da-855e-4282-ab70-9585a71212e7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1514 microversion: 2.1 time: 0.147608 Oct 12 00:22:52.676488 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 186/363] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:52 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:53.253370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:53.253988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:53.263453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:53.264698 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:53.265137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:53.266437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:53.266917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:53.267350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:53.412450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:53.422197 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e8ebb689-f4fe-41b2-b008-8ecaf0d323d3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.172833 Oct 12 00:22:53.423502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 178/364] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:53 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:53.453193 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-cf0f1bff-e406-4933-861e-f50bb0211c39 req-193ab0b8-2dd4-46bf-8070-a4e5939b0854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9c8dee-c875-4d23-a52e-5cd497cb44a9", "name": "network-vif-deleted", "tag": "e3d5ab75-eab0-4395-90b9-5ea8ff2ffa6e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:53.463022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cf0f1bff-e406-4933-861e-f50bb0211c39 req-193ab0b8-2dd4-46bf-8070-a4e5939b0854 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:53.463305 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cf0f1bff-e406-4933-861e-f50bb0211c39 req-193ab0b8-2dd4-46bf-8070-a4e5939b0854 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:53.463748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cf0f1bff-e406-4933-861e-f50bb0211c39 req-193ab0b8-2dd4-46bf-8070-a4e5939b0854 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:53.474969 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-332c70fa-43b8-4d08-b5ee-b9afb4a9f277 req-b1a7e436-eba1-4a0a-b085-afc13b2ea26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d008f88e-de37-4b22-b411-7a5de1fef288", "name": "network-vif-plugged", "status": "completed", "tag": "286053d8-514a-44bb-93e8-8591874205f2"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:53.476153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-cf0f1bff-e406-4933-861e-f50bb0211c39 req-193ab0b8-2dd4-46bf-8070-a4e5939b0854 service nova] Creating event network-vif-deleted:e3d5ab75-eab0-4395-90b9-5ea8ff2ffa6e for instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 on hv-cinder-84914 Oct 12 00:22:53.481974 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-cf0f1bff-e406-4933-861e-f50bb0211c39 req-193ab0b8-2dd4-46bf-8070-a4e5939b0854 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032929 Oct 12 00:22:53.482739 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 187/365] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:53.485821 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-332c70fa-43b8-4d08-b5ee-b9afb4a9f277 req-b1a7e436-eba1-4a0a-b085-afc13b2ea26c service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:53.486301 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-332c70fa-43b8-4d08-b5ee-b9afb4a9f277 req-b1a7e436-eba1-4a0a-b085-afc13b2ea26c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:53.486738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-332c70fa-43b8-4d08-b5ee-b9afb4a9f277 req-b1a7e436-eba1-4a0a-b085-afc13b2ea26c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:53.498563 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-332c70fa-43b8-4d08-b5ee-b9afb4a9f277 req-b1a7e436-eba1-4a0a-b085-afc13b2ea26c service nova] Creating event network-vif-plugged:286053d8-514a-44bb-93e8-8591874205f2 for instance d008f88e-de37-4b22-b411-7a5de1fef288 on hv-cinder-84914 Oct 12 00:22:53.503477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-332c70fa-43b8-4d08-b5ee-b9afb4a9f277 req-b1a7e436-eba1-4a0a-b085-afc13b2ea26c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032115 Oct 12 00:22:53.504005 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 179/366] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:22:53.698764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:53.699664 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:53.706764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:53.706764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:53.706764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:53.707418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:53.708072 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:53.708488 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:53.770832 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:53.778587 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-10fb22e1-0cec-455a-9b0c-0bdcf9aed510 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1304 microversion: 2.1 time: 0.084100 Oct 12 00:22:53.779145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 188/367] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:53 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:54.447484 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:54.448179 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:54.454309 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:54.454791 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:54.455223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:54.455945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:54.456396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:54.456821 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:54.587245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:54.595575 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a4aec11a-c83a-43e2-9ad7-ecc3a86e2cdd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.153230 Oct 12 00:22:54.596134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 180/368] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:54 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:54.802274 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:54.802839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:54.809293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:54.809782 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:54.810212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:54.810900 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:54.811354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:54.811798 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:54.842357 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:54.842821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:54.843243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:54.843713 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lazy-loading 'fault' on Instance uuid 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:22:54.887955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:54.895508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-586e152f-ca33-4cda-90f1-905216cdc77b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1309 microversion: 2.1 time: 0.097200 Oct 12 00:22:54.896081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 189/369] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:54 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:55.617975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:55.618586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:55.625328 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:55.625482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:55.626042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:55.626732 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:55.627184 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:55.627636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:55.756682 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:55.764936 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-915cf513-d514-4ed1-b027-c78037d5eb91 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1358 microversion: 2.1 time: 0.150801 Oct 12 00:22:55.765503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 181/370] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:55 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:55.918421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:55.919093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:55.925032 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:55.925517 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:55.925963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:55.926653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:55.927107 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:55.927562 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:55.958694 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:55.959094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:55.959565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:55.960012 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lazy-loading 'fault' on Instance uuid 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:22:55.998864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:56.006497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-167ffec6-5bf6-4979-93ae-2b3d26999d7f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 200 len: 1309 microversion: 2.1 time: 0.091952 Oct 12 00:22:56.007057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 190/371] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:55 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:56.638896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:56.639427 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:56.645783 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:56.646265 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:56.646730 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:56.647437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:56.647888 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:56.648309 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:56.671891 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f77cda2d-4cb2-4655-ad35-ceb660f8338b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/ips" status: 200 len: 151 microversion: 2.20 time: 0.037153 Oct 12 00:22:56.672443 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 182/372] 10.222.0.36 () {60 vars in 1289 bytes} [Wed Oct 12 00:22:56 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:22:56.788568 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:56.789171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:56.795704 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:56.796126 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:56.796555 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:56.797240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:56.797683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:56.798097 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:56.933393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:56.941088 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f7423369-2962-492c-a61c-8f7fdf3a6fef tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1548 microversion: 2.1 time: 0.156432 Oct 12 00:22:56.942260 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 191/373] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:56 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:56.965083 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:56.965695 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:56.971680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:56.972152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:56.972587 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:56.973280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:56.973728 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:56.974152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:57.030945 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:57.031588 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: 8e9c8dee-c875-4d23-a52e-5cd497cb44a9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:57.037687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:57.038266 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:57.038698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:57.039409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:57.039869 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:57.040290 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:57.045209 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:22:57.054956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] HTTP exception thrown: Instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 could not be found. Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Request method failure captured: Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 HTTP/1.1 Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgiIhu52WQix4dWxRFP8iBFPpBywm5faCoBPN83iaOms6HBhg3pBniuVlYQ1g9OXf9Usc7r1hE88nP2FPeDt9JJcP2BKWXkU_5ImvBTN0AKD3IosbcKdtbd7-CnhFHYv52AIh_QjMHO3Jc8ITCGhVAfaXAP0nD3zTQM_84o1sxXwSow Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 4194baa4b1fe4ab2840720dbf012a2f3 Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1731173328 Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:22:57.056785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4194baa4b1fe4ab2840720dbf012a2f3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4194baa4b1fe4ab2840720dbf012a2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4194baa4b1fe4ab2840720dbf012a2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4194baa4b1fe4ab2840720dbf012a2f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesSnapshotTestJSON-1731173328 Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 4194baa4b1fe4ab2840720dbf012a2f3 Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1731173328 Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesSnapshotTestJSON-1731173328-project Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: b0791b4507cf48bca517f41f0feebd78 Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesSnapshotTestJSON-1731173328-project Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 could not be found. Oct 12 00:22:57.058399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '8e9c8dee-c875-4d23-a52e-5cd497cb44a9'} Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 could not be found. Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:22:57.059207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 could not be found. Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 could not be found. Oct 12 00:22:57.060635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:22:57.062312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Returning 404 to user: Instance 8e9c8dee-c875-4d23-a52e-5cd497cb44a9 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:22:57.062312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d0baee7b-9cad-4668-aca7-2662bc2c85d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9" status: 404 len: 111 microversion: 2.1 time: 0.031188 Oct 12 00:22:57.062312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 192/374] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:57 2022] GET /compute/v2.1/servers/8e9c8dee-c875-4d23-a52e-5cd497cb44a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:22:57.115337 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:57.124196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9ce3d2f8-4f4f-484e-9f06-e48640c460e3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1548 microversion: 2.1 time: 0.163488 Oct 12 00:22:57.124999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 183/375] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:56 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:57.146957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:57.152442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:57.153208 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Searching by: {'deleted': False, 'project_id': '33e38693dbe5490fb39cd1981274a5f6'} {{(pid=125810) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 00:22:57.159902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:57.160380 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:57.160814 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:57.161549 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:57.162002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:57.162422 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:57.251008 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.multi_cell_list [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125810) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 00:22:57.349145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7581d5d2-6663-4360-a4f8-bcfd325eec23 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206210 Oct 12 00:22:57.349740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 193/376] 10.222.0.36 () {58 vars in 1125 bytes} [Wed Oct 12 00:22:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:22:57.362446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:22:57.363206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:57.369427 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:57.369900 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:57.370493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:57.371179 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:57.371652 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:57.372117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:57.516676 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:22:57.522034 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c9d62301-43e8-4f9f-ac64-29d233b4f5b0 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1548 microversion: 2.1 time: 0.163669 Oct 12 00:22:57.522607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 184/377] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:22:57 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:22:59.907907 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:22:59.908435 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:22:59.914508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:59.914988 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:59.915821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:59.916514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:22:59.916963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:22:59.917384 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:22:59.939593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lazy-loading 'flavor' on Instance uuid 90ce674c-f9e8-476b-b1e2-fe18ba36050a {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:00.416179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-958efc9a-781b-40bd-9331-29cfc6302953 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/action" status: 202 len: 0 microversion: 2.20 time: 0.511451 Oct 12 00:23:00.416764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 194/378] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Oct 12 00:22:59 2022] POST /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:23:00.425060 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:00.430781 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:00.430781 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:00.434215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:00.434707 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:00.435141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:00.435868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:00.436310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:00.436724 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:00.460267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:00.563145 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:00.572453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:00.573905 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:00.575064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4f3ca8e3-a5d2-41a8-be81-1a352ca55948 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.153880 Oct 12 00:23:00.575661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 185/379] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:00 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:01.601186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:01.602389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:01.610339 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:01.610339 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:01.610339 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:01.610707 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:01.611007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:01.611481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:01.747305 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:01.755350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:01.756798 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:01.757943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-59e0e0fa-bb30-4e4f-9dd7-e4bbad2de862 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.161252 Oct 12 00:23:01.758493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 195/380] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:01 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:02.588847 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fb8929c-c472-40e5-879e-8bf356c5f1df"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:02.591299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:02.598496 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:02.598972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:02.599440 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:02.600130 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:02.600578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:02.601000 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:02.783622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:02.784154 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:02.790245 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:02.790713 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:02.791139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:02.791842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:02.792290 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:02.792706 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:02.920954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:02.929190 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:02.930726 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:02.931959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7783f32e-7655-4324-90f6-300a88497d0b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.152293 Oct 12 00:23:02.932954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 196/381] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:02 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:03.322482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ffb01840-221e-4e75-b3e6-bd82a288cb3e tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "POST /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.737222 Oct 12 00:23:03.323129 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 186/382] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:23:02 2022] POST /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:03.963944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:03.964458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:03.970343 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:03.970852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:03.971287 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:03.971999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:03.972452 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:03.972881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:04.100773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:04.109354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:04.110797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:04.111976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-45448c55-24f9-4c68-88a8-82ce2e9c4b37 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.152522 Oct 12 00:23:04.112532 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 197/383] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:03 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:05.138765 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:05.139505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:05.145627 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:05.146152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:05.146576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:05.147268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:05.147749 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:05.148209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:05.277866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:05.285952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:05.287403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:05.288553 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-87f6bf5a-675c-42c2-acbb-dfd7998380fc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.154887 Oct 12 00:23:05.289110 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 187/384] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:05 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:06.314245 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:06.314853 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:06.320824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:06.321919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:06.322358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:06.323051 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:06.323543 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:06.323970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:06.448330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:06.456317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:06.457792 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:06.458949 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a5579127-2e6d-4595-8d40-f9a39616b30b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.148599 Oct 12 00:23:06.459528 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 198/385] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:06 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:07.484465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:07.485070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:07.491556 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:07.492029 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:07.492455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:07.493132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:07.494101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:07.494517 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:07.626105 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:07.635632 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:07.637371 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:07.638539 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f32ccb35-38f7-49eb-afef-55b3d1a0bbf0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.157980 Oct 12 00:23:07.639282 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 188/386] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:07 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:07.727035 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1272082384", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "networks": [{"uuid": "fccd9e59-39c7-42a2-aa54-28f6a75073c4"}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:07.735605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:07.739309 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=62 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:07.783439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] validate_networks() for [('fccd9e59-39c7-42a2-aa54-28f6a75073c4', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:23:08.123879 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:23:08.124304 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:23:08.124811 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:23:08.125219 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:23:08.125632 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:23:08.134370 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:08.134850 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:08.135281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:08.136064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:08.136513 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:08.137186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:08.153446 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Getting quotas for project 4194baa4b1fe4ab2840720dbf012a2f3. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:23:08.157379 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Getting quotas for user b0791b4507cf48bca517f41f0feebd78 and project 4194baa4b1fe4ab2840720dbf012a2f3. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:23:08.168674 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:23:08.170898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:23:08.313025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3829e198-fd7e-48eb-b18e-54c1a08fcbfb tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589740 Oct 12 00:23:08.313923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 199/387] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:23:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 00:23:08.324817 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-770110b9-2f90-48bd-b26c-6c60cbdb932d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:08.325421 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-770110b9-2f90-48bd-b26c-6c60cbdb932d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:08.382642 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-770110b9-2f90-48bd-b26c-6c60cbdb932d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:08.390710 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-770110b9-2f90-48bd-b26c-6c60cbdb932d tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1219 microversion: 2.1 time: 0.069659 Oct 12 00:23:08.391278 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 189/388] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:08 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:08.671233 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:08.671914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:08.678785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:08.679277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:08.679748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:08.680481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:08.681101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:08.681530 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:09.050383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:09.059404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:09.060962 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:09.061962 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3c2a1e9c-b962-4c4b-bd37-aa6ad3abbcc7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.401626 Oct 12 00:23:09.062617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 200/389] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:08 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:09.414063 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d278edfe-ddf9-4718-8590-2c75c1730427 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:09.414676 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d278edfe-ddf9-4718-8590-2c75c1730427 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:09.468112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d278edfe-ddf9-4718-8590-2c75c1730427 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:09.476233 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d278edfe-ddf9-4718-8590-2c75c1730427 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1219 microversion: 2.1 time: 0.066061 Oct 12 00:23:09.476796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 190/390] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:09 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:10.088740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:10.089570 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:10.095570 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:10.096593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:10.096593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:10.097145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:10.097601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:10.098035 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:10.228720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:10.236843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:10.238278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:10.239455 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8ed98c4a-cdf2-47ac-85b2-fa9a59de4307 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.155258 Oct 12 00:23:10.240068 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 201/391] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:10 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:10.499975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:10.500575 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:10.507008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:10.507515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:10.507940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:10.508618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:10.509744 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:10.510251 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:10.575800 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:10.583551 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5fd50837-3988-468b-be98-594891121d19 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1215 microversion: 2.1 time: 0.087394 Oct 12 00:23:10.584114 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 191/392] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:10 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:11.264830 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:11.265445 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:11.271427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:11.272165 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:11.272597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:11.273295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:11.273751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:11.274172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:11.404509 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:11.412588 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:11.414033 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:11.415822 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0c4d0d76-dbb1-4ae8-8cea-065a999fcad7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.154532 Oct 12 00:23:11.416381 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 202/393] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:11 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:11.608243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:11.608851 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:11.615206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:11.615731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:11.616165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:11.616850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:11.617305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:11.617729 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:11.678027 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:11.685533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f94e4ac1-d3d7-4888-bcd8-cc30176292d0 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1271 microversion: 2.1 time: 0.081185 Oct 12 00:23:11.686126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 192/394] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:11 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:12.441111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:12.441717 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:12.447727 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:12.448201 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:12.448625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:12.449308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:12.449753 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:12.450167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:12.657338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:12.665963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:12.668803 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:12.668803 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-16c73ce4-787d-4dca-bec6-659746530e63 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.231340 Oct 12 00:23:12.669354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 203/395] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:12 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:12.708758 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:12.709493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:12.716209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:12.723661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:12.723661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:12.723661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:12.723661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:12.724028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:12.782242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:12.791234 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ddbcdb00-3404-4546-9df1-3ce13e1f0b04 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1277 microversion: 2.1 time: 0.086293 Oct 12 00:23:12.791964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 193/396] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:12 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:13.693973 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:13.694608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:13.701469 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:13.704216 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:13.704216 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:13.704216 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:13.704216 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:13.704661 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:13.806476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-ba6ce718-62f4-4312-b4ea-62405d18c549 req-325ff7c2-259c-4029-b671-30fb68d9e1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fff79ad8-fc4e-4a17-930a-6e1e1344e251", "tag": "dbb99aba-88ee-4441-85ff-aef564d9b583"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:13.816804 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-ba6ce718-62f4-4312-b4ea-62405d18c549 req-325ff7c2-259c-4029-b671-30fb68d9e1dc service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:13.817276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-ba6ce718-62f4-4312-b4ea-62405d18c549 req-325ff7c2-259c-4029-b671-30fb68d9e1dc service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:13.817702 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-ba6ce718-62f4-4312-b4ea-62405d18c549 req-325ff7c2-259c-4029-b671-30fb68d9e1dc service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:13.829043 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-ba6ce718-62f4-4312-b4ea-62405d18c549 req-325ff7c2-259c-4029-b671-30fb68d9e1dc service nova] Creating event network-changed:dbb99aba-88ee-4441-85ff-aef564d9b583 for instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 on hv-cinder-84914 Oct 12 00:23:13.833883 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-ba6ce718-62f4-4312-b4ea-62405d18c549 req-325ff7c2-259c-4029-b671-30fb68d9e1dc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031967 Oct 12 00:23:13.834630 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 194/397] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:23:13.839314 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:13.840055 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:13.846070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:13.846545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:13.846979 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:13.847701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:13.848152 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:13.853478 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:13.891217 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:13.899761 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:13.901190 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:13.902344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c77849c2-1f22-4cd0-b15e-8035d51700d6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.212232 Oct 12 00:23:13.902899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 204/398] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:13 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:13.982289 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:13.990014 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b607e82f-b729-4299-9e88-b9dd4104ba5a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1319 microversion: 2.1 time: 0.154489 Oct 12 00:23:13.990573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 195/399] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:13 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:14.928705 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:14.929313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:14.935551 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:14.936031 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:14.936459 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:14.937181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:14.937638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:14.938060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:15.013890 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:15.014503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:15.021460 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:15.022167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:15.022834 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:15.023887 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:15.024594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:15.025241 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:15.074482 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:15.082618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:15.084076 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:15.085213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d0c7605b-5f68-40fa-af31-cca3da6d7b96 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.160483 Oct 12 00:23:15.098577 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 205/400] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:14 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:15.166012 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:15.169059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:15.169670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:15.174230 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-25772e54-b382-4fc9-8906-b8e31780b197 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1319 microversion: 2.1 time: 0.164587 Oct 12 00:23:15.174813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 196/401] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:15 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:15.175493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:15.176041 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:15.176460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:15.177142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:15.177586 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:15.177995 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:15.307416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:15.315855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-113ac722-874b-4945-99de-984a9c371faf tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1594 microversion: 2.1 time: 0.151624 Oct 12 00:23:15.316406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 206/402] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:15 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:16.111240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:16.111883 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:16.118205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:16.118679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:16.119111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:16.119820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:16.120268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:16.120689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:16.198063 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:16.198675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:16.204566 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:16.205050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:16.205485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:16.206178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:16.206631 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:16.207053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:16.358879 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:16.367353 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:16.372232 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e6fc488d-b13e-4416-a840-07f4831f0e16 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1319 microversion: 2.1 time: 0.178365 Oct 12 00:23:16.377311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 207/403] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:16 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:16.409425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:16.421104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:16.423316 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:16.424941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-86a2df44-4e0a-4f39-b572-a4c6eaeb8eed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.317604 Oct 12 00:23:16.426261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 197/404] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:16 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:17.396155 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:17.396901 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:17.404668 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:17.404809 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:17.405298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:17.406076 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:17.406534 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:17.406992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:17.451729 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:17.452425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:17.463415 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:17.463907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:17.471379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:17.472137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:17.472770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:17.473358 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:17.580319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:17.588388 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-28bdd71f-abd2-45f6-adf5-e49c16a8226f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1319 microversion: 2.1 time: 0.196074 Oct 12 00:23:17.589230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 208/405] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:17 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:17.615870 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-43e3a828-e037-4fcf-8275-504fea1b0be2 req-cbb8a553-30c0-4263-bce8-84aadacd2df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d008f88e-de37-4b22-b411-7a5de1fef288", "tag": "286053d8-514a-44bb-93e8-8591874205f2"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:17.630203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-43e3a828-e037-4fcf-8275-504fea1b0be2 req-cbb8a553-30c0-4263-bce8-84aadacd2df9 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:17.630904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-43e3a828-e037-4fcf-8275-504fea1b0be2 req-cbb8a553-30c0-4263-bce8-84aadacd2df9 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:17.631527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-43e3a828-e037-4fcf-8275-504fea1b0be2 req-cbb8a553-30c0-4263-bce8-84aadacd2df9 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:17.644089 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-43e3a828-e037-4fcf-8275-504fea1b0be2 req-cbb8a553-30c0-4263-bce8-84aadacd2df9 service nova] Creating event network-changed:286053d8-514a-44bb-93e8-8591874205f2 for instance d008f88e-de37-4b22-b411-7a5de1fef288 on hv-cinder-84914 Oct 12 00:23:17.650254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-43e3a828-e037-4fcf-8275-504fea1b0be2 req-cbb8a553-30c0-4263-bce8-84aadacd2df9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038619 Oct 12 00:23:17.651210 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 209/406] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:17.652122 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:17.660792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:17.662211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:17.663411 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-249e66c6-cb6c-4087-8318-812ee480b412 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1745 microversion: 2.20 time: 0.215711 Oct 12 00:23:17.664139 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 198/407] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:17 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1745 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:18.614291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:18.615647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:18.618029 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:18.618692 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:18.624402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:18.625074 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:18.625505 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:18.626371 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:18.626828 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:18.627243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:18.690160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:18.690771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:18.697482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:18.698897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:18.698897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:18.699243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:18.699608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:18.700077 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:18.765159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:18.773624 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-88846c42-310c-4b2f-b28e-a2fb832f61ab tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1319 microversion: 2.1 time: 0.163740 Oct 12 00:23:18.780158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 210/408] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:18 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:18.849529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:18.857806 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:18.859222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:18.860393 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-17b0fd67-4041-42fa-b2ed-b6cf07b22224 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1745 microversion: 2.20 time: 0.174144 Oct 12 00:23:18.861091 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 199/409] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:18 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:19.688041 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-4e4d41db-1bc0-48cc-82c8-c91cece65785 req-c1286c1f-f8c6-46d2-a4b3-398e9628a53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff79ad8-fc4e-4a17-930a-6e1e1344e251", "name": "network-vif-plugged", "status": "completed", "tag": "dbb99aba-88ee-4441-85ff-aef564d9b583"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:19.697453 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4e4d41db-1bc0-48cc-82c8-c91cece65785 req-c1286c1f-f8c6-46d2-a4b3-398e9628a53a service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:19.700512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4e4d41db-1bc0-48cc-82c8-c91cece65785 req-c1286c1f-f8c6-46d2-a4b3-398e9628a53a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:19.700512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4e4d41db-1bc0-48cc-82c8-c91cece65785 req-c1286c1f-f8c6-46d2-a4b3-398e9628a53a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:19.708904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-4e4d41db-1bc0-48cc-82c8-c91cece65785 req-c1286c1f-f8c6-46d2-a4b3-398e9628a53a service nova] Creating event network-vif-plugged:dbb99aba-88ee-4441-85ff-aef564d9b583 for instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 on hv-cinder-84914 Oct 12 00:23:19.714037 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-4e4d41db-1bc0-48cc-82c8-c91cece65785 req-c1286c1f-f8c6-46d2-a4b3-398e9628a53a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030008 Oct 12 00:23:19.714629 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 211/410] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:19.797080 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:19.797696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:19.799941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=4 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:19.805390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:19.805873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:19.807620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:19.807620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:19.807620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:19.807910 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:19.887442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:19.888132 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:19.894215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:19.894685 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:19.895111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:19.895902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:19.896348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:19.896792 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:19.950617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:19.958395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-aeefc87f-93ae-4bf8-90ab-103747a2eb20 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1319 microversion: 2.1 time: 0.165446 Oct 12 00:23:19.958963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 200/411] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:19 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:20.072397 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:20.081313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:20.082791 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:20.083982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ff81992c-4e52-45d9-bfe6-b157b11812b5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1745 microversion: 2.20 time: 0.201666 Oct 12 00:23:20.084548 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 212/412] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:19 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1745 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:20.262045 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1141163874"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:20.262584 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:20.268602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:20.269156 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:20.269591 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:20.270276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:20.270729 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:20.271146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:20.394408 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.network.security_group_api [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Adding security group f0c83657-5631-4236-9279-5a0a82070e50 to port 286053d8-514a-44bb-93e8-8591874205f2 Oct 12 00:23:20.781428 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-677f7e7c-7b1a-42c5-b96d-4b20c92d7e09 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "POST /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/action" status: 202 len: 0 microversion: 2.1 time: 0.524275 Oct 12 00:23:20.782033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 201/413] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:23:20 2022] POST /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:23:20.790961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:20.791479 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-547f696c-6a9a-4950-8786-89685b3fbe6e req-4cda7d1a-9acd-4e70-837d-63015ad92a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d008f88e-de37-4b22-b411-7a5de1fef288", "tag": "286053d8-514a-44bb-93e8-8591874205f2"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:20.791604 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:20.797655 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:20.798131 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:20.798559 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:20.799252 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:20.799722 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:20.800145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:20.800773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-547f696c-6a9a-4950-8786-89685b3fbe6e req-4cda7d1a-9acd-4e70-837d-63015ad92a1c service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:20.801240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-547f696c-6a9a-4950-8786-89685b3fbe6e req-4cda7d1a-9acd-4e70-837d-63015ad92a1c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:20.801663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-547f696c-6a9a-4950-8786-89685b3fbe6e req-4cda7d1a-9acd-4e70-837d-63015ad92a1c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:20.813328 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-547f696c-6a9a-4950-8786-89685b3fbe6e req-4cda7d1a-9acd-4e70-837d-63015ad92a1c service nova] Creating event network-changed:286053d8-514a-44bb-93e8-8591874205f2 for instance d008f88e-de37-4b22-b411-7a5de1fef288 on hv-cinder-84914 Oct 12 00:23:20.819993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-547f696c-6a9a-4950-8786-89685b3fbe6e req-4cda7d1a-9acd-4e70-837d-63015ad92a1c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032291 Oct 12 00:23:20.820896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 202/414] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:20.957611 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:20.966223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-504868bc-6e82-4a20-b174-a3b9cd96dbca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1759 microversion: 2.1 time: 0.179639 Oct 12 00:23:20.966789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 213/415] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:20 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:20.982895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:20.983717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:20.989886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:20.990366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:20.990790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:20.991505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:20.991950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:20.992367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:21.110156 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:21.110757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:21.117249 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:21.117902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:21.118874 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:21.119619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:21.120081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:21.121015 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:21.126253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:21.133893 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-edb42dc0-45b4-4323-a82c-dacfb002f249 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1319 microversion: 2.1 time: 0.155417 Oct 12 00:23:21.135446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 203/416] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:20 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:21.251314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:21.259790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:21.261397 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:21.262914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-45d42e2c-9f8e-4160-81ec-428f998f250a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1745 microversion: 2.20 time: 0.156972 Oct 12 00:23:21.263592 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 214/417] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:21 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:22.157280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:22.159406 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:22.164857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:22.165327 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:22.165749 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:22.166421 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:22.166861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:22.167271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:22.193955 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:22.288728 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:22.289821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:22.295648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:22.296110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:22.296538 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:22.297229 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:22.297739 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:22.298321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:22.298458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:22.306678 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-dac25186-ea0a-44bc-a885-61d72b8f282a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1319 microversion: 2.1 time: 0.153223 Oct 12 00:23:22.307319 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 204/418] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:22 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:22.425116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:22.433786 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:22.435204 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:22.436366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-de4a2835-0fbc-4a06-99e2-cbcb313d808a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.151640 Oct 12 00:23:22.436916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 215/419] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:22 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:23.330536 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:23.331143 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:23.338270 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:23.338959 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:23.339597 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:23.340297 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:23.340751 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:23.341168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:23.463661 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:23.464316 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:23.488739 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:23.489243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:23.489678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:23.490385 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:23.490833 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:23.491246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:23.509578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:23.522391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2823d6b8-1f5e-4739-bef7-957203e126d2 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1507 microversion: 2.1 time: 0.194904 Oct 12 00:23:23.524322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 205/420] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:23 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:23.554059 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4ac92dd-506d-4870-bea0-da98156f34f0", "device": "/dev/sdb"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:23.557407 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:23.563932 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:23.564425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:23.564957 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:23.565786 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:23.566239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:23.566829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:23.662838 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:23.672160 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:23.673909 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:23.675330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f9017082-a002-4e27-84f5-2ed0c24ab7b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.216707 Oct 12 00:23:23.676355 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 216/421] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:23 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:23.868335 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-c03a6eb3-1182-4da5-a5d8-6f775aaaa48f req-9f47211c-33e4-4184-b06b-cfe63dd4e14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce674c-f9e8-476b-b1e2-fe18ba36050a", "name": "network-vif-plugged", "status": "completed", "tag": "2dccc06d-e6ad-4199-a897-4c5df8e17ccf"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:23.878237 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c03a6eb3-1182-4da5-a5d8-6f775aaaa48f req-9f47211c-33e4-4184-b06b-cfe63dd4e14c service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:23.879107 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c03a6eb3-1182-4da5-a5d8-6f775aaaa48f req-9f47211c-33e4-4184-b06b-cfe63dd4e14c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:23.879707 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c03a6eb3-1182-4da5-a5d8-6f775aaaa48f req-9f47211c-33e4-4184-b06b-cfe63dd4e14c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:23.893585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-c03a6eb3-1182-4da5-a5d8-6f775aaaa48f req-9f47211c-33e4-4184-b06b-cfe63dd4e14c service nova] Creating event network-vif-plugged:2dccc06d-e6ad-4199-a897-4c5df8e17ccf for instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a on hv-cinder-84914 Oct 12 00:23:23.900538 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-c03a6eb3-1182-4da5-a5d8-6f775aaaa48f req-9f47211c-33e4-4184-b06b-cfe63dd4e14c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035704 Oct 12 00:23:23.901670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 217/422] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:23:24.512559 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4bac4a16-713b-4f60-9214-b35849d3b6f7 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "POST /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.965994 Oct 12 00:23:24.514810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 206/423] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:23:23 2022] POST /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:23:24.703018 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:24.705912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:24.713518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:24.714815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:24.715746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:24.716648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:24.717101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:24.717523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:24.866028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:24.877682 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:24.879337 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:24.880689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c8fe3e44-6992-453e-921b-502d0887ddcb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.182297 Oct 12 00:23:24.881329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 218/424] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:24 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:25.908940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:25.909625 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:25.916304 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:25.916774 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:25.917201 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:25.917879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:25.918323 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:25.918738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:26.047235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:26.056246 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:26.057687 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:26.058848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-955c6e11-fc74-46a7-a265-1aa3ed8b86af tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.154774 Oct 12 00:23:26.059423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 207/425] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:25 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:27.084155 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:27.085433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:27.091839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:27.092314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:27.092740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:27.093426 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:27.093866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:27.094320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:27.238615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:27.247530 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:27.248980 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:27.250138 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bef18187-6dd5-42ec-be4e-9c6872e45f51 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.169916 Oct 12 00:23:27.250878 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 219/426] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:27 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:28.277819 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:28.278447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:28.286041 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:28.286615 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:28.287117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:28.288296 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:28.289472 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:28.290109 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:28.446636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:28.455568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:28.457054 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:28.458828 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e9011f94-6da6-461e-b204-0a2eece7c5c5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.186257 Oct 12 00:23:28.461153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 208/427] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:28 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:28.738654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:28.739234 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:28.746007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:28.746491 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:28.746922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:28.747658 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:28.748119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:28.748528 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:28.775205 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-85e9d0a2-ff16-4bb5-8f2d-f5506d18b4f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b/ips" status: 200 len: 150 microversion: 2.1 time: 0.040523 Oct 12 00:23:28.775818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 220/428] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:23:28 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:28.787607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29f41764-fe52-49a9-ad4d-8139a0619070"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:28.790135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:28.796659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:28.799961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:28.800455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:28.801196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:28.801661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:28.802082 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:28.914358 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Invalid volume: volume 29f41764-fe52-49a9-ad4d-8139a0619070 is already attached to instances: 84d5f38e-5fbf-4a54-adf9-6025f1358776 Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: POST /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b/os-volume_attachments HTTP/1.1 Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 74 Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:23:28.916191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {"volumeAttachment": {"volumeId": "29f41764-fe52-49a9-ad4d-8139a0619070"}} Oct 12 00:23:28.917482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Invalid volume: volume 29f41764-fe52-49a9-ad4d-8139a0619070 is already attached to instances: 84d5f38e-5fbf-4a54-adf9-6025f1358776 Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'server_id': '69a75274-767b-4dd6-86bc-536d9a96b07b', 'body': {'volumeAttachment': {'volumeId': '29f41764-fe52-49a9-ad4d-8139a0619070'}}} Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 29f41764-fe52-49a9-ad4d-8139a0619070 is already attached to instances: 84d5f38e-5fbf-4a54-adf9-6025f1358776 Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:28.918401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 29f41764-fe52-49a9-ad4d-8139a0619070 is already attached to instances: 84d5f38e-5fbf-4a54-adf9-6025f1358776 Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:28.919820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:23:28.921206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:23:28.921206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:23:28.921206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:23:28.921206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 29f41764-fe52-49a9-ad4d-8139a0619070 is already attached to instances: 84d5f38e-5fbf-4a54-adf9-6025f1358776 Oct 12 00:23:28.921206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:28.921206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 400 to user: Invalid volume: volume 29f41764-fe52-49a9-ad4d-8139a0619070 is already attached to instances: 84d5f38e-5fbf-4a54-adf9-6025f1358776 {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:23:28.921206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6ab12252-8308-4d50-8c1c-d829d113bc56 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134172 Oct 12 00:23:28.921206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 209/429] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:23:28 2022] POST /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:23:28.926807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:28.927324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:28.934047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:28.934523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:28.934955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:28.935673 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:28.936126 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:28.936555 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:28.962067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:23:29.484709 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:29.485997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:29.495122 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:29.496356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:29.496981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:29.497862 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:29.498744 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:29.499174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:29.508560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5ce5b722-79e4-44a7-bc1e-50b6ec5443ca tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 204 len: 0 microversion: 2.1 time: 0.585269 Oct 12 00:23:29.512895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 221/430] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:23:28 2022] DELETE /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 00:23:29.518089 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:29.518822 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:29.526056 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:29.526959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:29.527602 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:29.528615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:29.529816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:29.530162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:29.670289 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:29.678893 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:29.680759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:29.682138 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-01afd804-3291-4674-a257-bb7e35edd44e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.201540 Oct 12 00:23:29.682888 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 210/431] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:29 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:29.713845 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:29.722921 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8f1398ce-f6ad-4282-b620-e644eb7f7c21 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1682 microversion: 2.1 time: 0.208209 Oct 12 00:23:29.722921 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 222/432] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:29 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:30.710268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:30.711808 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:30.714848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=56 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:30.720655 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:30.721231 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:30.721896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:30.722608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:30.723060 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:30.723528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:30.747752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:30.749245 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:30.756242 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:30.756813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:30.757253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:30.758160 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:30.759095 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:30.759553 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:30.866507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:30.878302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:30.880421 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:30.881742 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-cd2de753-e6f4-405e-94aa-ae79e7d18519 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.175545 Oct 12 00:23:30.883058 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 211/433] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:30 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:30.955010 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:30.963672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-32da7a67-a1a9-4b26-a00f-cc4e128bbea0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1682 microversion: 2.1 time: 0.221386 Oct 12 00:23:30.965656 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 223/434] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:30 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:31.910373 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:31.910974 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:31.918411 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:31.918893 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:31.919322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:31.920098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:31.920549 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:31.920969 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:31.995817 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:31.997565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:32.006643 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:32.007421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:32.008275 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:32.009447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:32.010304 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:32.010958 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:32.089376 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:32.100190 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:32.102774 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:32.103982 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8fe42675-54b7-47ad-bfb5-ebe22284a46d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.197680 Oct 12 00:23:32.104711 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 212/435] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:31 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:32.164105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:32.173396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4735b6f1-5c6e-424f-b684-1b2af26f24f7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1682 microversion: 2.1 time: 0.186571 Oct 12 00:23:32.173952 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 224/436] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:31 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:32.439765 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb44b640-ea6c-4bc8-b8b1-7ea33fb48f04"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:32.442322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:32.448208 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:32.448691 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:32.449124 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:32.449815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:32.450275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:32.450696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:33.144332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:33.145340 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:33.178014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:33.178681 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:33.180692 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:33.182067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:33.184896 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:33.188924 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:33.229142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:33.362559 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-db7e4758-d317-42c2-ab39-c4c7468b1591 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.926522 Oct 12 00:23:33.364003 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 213/437] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:23:32 2022] POST /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:33.374717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:33.380075 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:33.392580 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:33.393338 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:33.394105 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:33.399451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:33.400337 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:33.400961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:33.506450 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:33.534625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:33.545638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:33.549224 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-08e96e2b-e16b-46c5-8169-0c51b7262544 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.411094 Oct 12 00:23:33.558071 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 225/438] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:33 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:33.565934 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:33.580767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-cf36252e-a3a8-41c0-8033-b8d5eda485fc tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1614 microversion: 2.1 time: 0.215369 Oct 12 00:23:33.584182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 214/439] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:33 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1614 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:33.597730 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-f820ed33-d594-4f39-a584-c170b908de1a req-bb689a6e-a9d8-4bbf-9837-f92a433a4820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a75274-767b-4dd6-86bc-536d9a96b07b", "name": "network-vif-deleted", "tag": "617aaa52-3f6e-495d-a0e1-b133ca5d63c3"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:33.620381 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f820ed33-d594-4f39-a584-c170b908de1a req-bb689a6e-a9d8-4bbf-9837-f92a433a4820 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:33.636804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f820ed33-d594-4f39-a584-c170b908de1a req-bb689a6e-a9d8-4bbf-9837-f92a433a4820 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:33.636804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f820ed33-d594-4f39-a584-c170b908de1a req-bb689a6e-a9d8-4bbf-9837-f92a433a4820 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:33.636804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-f820ed33-d594-4f39-a584-c170b908de1a req-bb689a6e-a9d8-4bbf-9837-f92a433a4820 service nova] Creating event network-vif-deleted:617aaa52-3f6e-495d-a0e1-b133ca5d63c3 for instance 69a75274-767b-4dd6-86bc-536d9a96b07b on hv-cinder-84914 Oct 12 00:23:33.643531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-f820ed33-d594-4f39-a584-c170b908de1a req-bb689a6e-a9d8-4bbf-9837-f92a433a4820 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049036 Oct 12 00:23:33.645576 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 226/440] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:23:34.582876 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:34.584051 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:34.590927 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:34.591564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:34.592109 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:34.592934 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:34.593488 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:34.594137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:34.613017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:34.613703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:34.620599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:34.621298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:34.621892 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:34.622750 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:34.623387 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:34.623905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:34.660643 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:34.661470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:34.662073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:34.662663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 69a75274-767b-4dd6-86bc-536d9a96b07b {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:34.735463 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:34.747618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e62778f8-b71c-4485-aaf9-368390cb07b2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1331 microversion: 2.1 time: 0.138681 Oct 12 00:23:34.748393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 227/441] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:34 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:34.820075 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:34.835015 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:34.836868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:34.838744 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b5f55cb0-2ec9-4eeb-a6c1-68379a55235d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1740 microversion: 2.20 time: 0.260170 Oct 12 00:23:34.850492 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 215/442] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:34 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:35.773748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:35.774940 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:35.780879 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:35.781356 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:35.781787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:35.782470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:35.782916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:35.783345 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:35.812814 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:35.813290 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:35.813723 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:35.814159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 69a75274-767b-4dd6-86bc-536d9a96b07b {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:35.855227 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:35.862310 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f5369e92-a1d3-4b97-b2f4-7b39a7c4a87d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1331 microversion: 2.1 time: 0.092432 Oct 12 00:23:35.862863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 228/443] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:35 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:35.866752 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:35.867516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:35.874085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:35.874565 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:35.875004 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:35.875729 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:35.876235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:35.876633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:36.004157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:36.012986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:36.014434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:36.015635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ca036f1a-38ee-428d-9e5e-0fe88003c805 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1722 microversion: 2.20 time: 0.152673 Oct 12 00:23:36.016214 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 216/444] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:35 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:36.885140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:36.885746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:36.899589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:36.899589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:36.899589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:36.899589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:36.899905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:36.899905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:36.924949 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:36.925414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:36.925836 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:36.926283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 69a75274-767b-4dd6-86bc-536d9a96b07b {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:36.965334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:36.972847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-108679b9-c237-4cfb-9211-9b6cd04f7c83 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1331 microversion: 2.1 time: 0.091455 Oct 12 00:23:36.973399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 229/445] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:36 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:37.041626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:37.042233 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:37.048611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:37.049094 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:37.051168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:37.051168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:37.051168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:37.051168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:37.176513 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:37.184805 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:37.186239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:37.187406 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9ed1e925-9bd3-412b-a4d2-c29927a96e23 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1722 microversion: 2.20 time: 0.150330 Oct 12 00:23:37.187958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 217/446] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:37 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:37.997678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:38.000754 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:38.000754 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:38.006145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:38.006625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:38.007060 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:38.007979 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:38.008438 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:38.008852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:38.043338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:38.043842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:38.044275 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:38.044715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 69a75274-767b-4dd6-86bc-536d9a96b07b {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:38.118738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:38.126254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1145fb4a-5302-455f-86dd-26bf7ef8c09c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 200 len: 1331 microversion: 2.1 time: 0.133536 Oct 12 00:23:38.126754 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 230/447] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:37 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 1331 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:38.213871 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:38.214475 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:38.220795 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:38.221274 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:38.221706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:38.222406 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:38.222858 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:38.223281 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:38.241629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:38.260473 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-4ff1ebc3-df2b-485d-bfe9-ff059c019028 req-498c0e7e-f4af-4767-8a87-7c5609f16a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce674c-f9e8-476b-b1e2-fe18ba36050a", "name": "network-vif-unplugged", "status": "completed", "tag": "2dccc06d-e6ad-4199-a897-4c5df8e17ccf"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:38.271019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4ff1ebc3-df2b-485d-bfe9-ff059c019028 req-498c0e7e-f4af-4767-8a87-7c5609f16a52 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:38.271584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4ff1ebc3-df2b-485d-bfe9-ff059c019028 req-498c0e7e-f4af-4767-8a87-7c5609f16a52 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:38.273643 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4ff1ebc3-df2b-485d-bfe9-ff059c019028 req-498c0e7e-f4af-4767-8a87-7c5609f16a52 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:38.283801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-4ff1ebc3-df2b-485d-bfe9-ff059c019028 req-498c0e7e-f4af-4767-8a87-7c5609f16a52 service nova] Creating event network-vif-unplugged:2dccc06d-e6ad-4199-a897-4c5df8e17ccf for instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a on hv-cinder-84914 Oct 12 00:23:38.288620 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-4ff1ebc3-df2b-485d-bfe9-ff059c019028 req-498c0e7e-f4af-4767-8a87-7c5609f16a52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032229 Oct 12 00:23:38.289202 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 231/448] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:23:38.358659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:38.366939 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:38.368417 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:38.371068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-353b687e-6494-47ed-98b7-a14925704bea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1722 microversion: 2.20 time: 0.160157 Oct 12 00:23:38.371068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 218/449] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:38 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:39.149711 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:39.150432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:39.156667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:39.157134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:39.157557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:39.158228 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:39.158671 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:39.159101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:39.171964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b HTTP/1.1 Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:23:39.173486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:23:39.175028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '69a75274-767b-4dd6-86bc-536d9a96b07b'} Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:23:39.176093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:23:39.177609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:39.178985 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:23:39.178985 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1e2ad1a7-b486-45af-b669-71be6dacb546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 404 len: 111 microversion: 2.1 time: 0.029453 Oct 12 00:23:39.178985 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 232/450] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:39 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:23:39.184574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3b0deb8b-c2f9-44c7-bc98-159958f382f0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '.version_select at 0x7f2fe8edd040>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:39.274502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3b0deb8b-c2f9-44c7-bc98-159958f382f0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376412044" status: 202 len: 0 microversion: 2.1 time: 0.094139 Oct 12 00:23:39.275146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 219/451] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Oct 12 00:23:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376412044 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:23:39.395407 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:39.396278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:39.402007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:39.402478 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:39.402903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:39.403610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:39.404052 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:39.404470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:39.554485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:39.563311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:39.564802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:39.565984 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b33f6de1-42b5-4c2a-b8e8-ff8d494458c3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1722 microversion: 2.20 time: 0.174397 Oct 12 00:23:39.566544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 233/452] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:39 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:40.075753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:40.076245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:40.082191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:40.082671 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:40.083099 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:40.083801 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:40.084249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:40.084664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:40.164372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'services' on Instance uuid 84d5f38e-5fbf-4a54-adf9-6025f1358776 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:40.398089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8e31059d-fdd1-43f4-b839-690d47ddbd94 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments/29f41764-fe52-49a9-ad4d-8139a0619070" status: 202 len: 0 microversion: 2.1 time: 0.326235 Oct 12 00:23:40.398694 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 220/453] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:23:40 2022] DELETE /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments/29f41764-fe52-49a9-ad4d-8139a0619070 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:23:40.407541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:40.409667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:40.415759 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:40.416815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:40.417246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:40.417939 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:40.418396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:40.418821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:40.447262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3305ca26-3843-4b4f-96b6-c79d851788a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Oct 12 00:23:40.447769 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 234/454] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:23:40 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:40.591951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:40.592642 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:40.598986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:40.599497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:40.599930 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:40.600606 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:40.601050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:40.601464 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:40.727587 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:40.736099 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:40.737538 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:40.738679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-27f0a926-4854-4d65-a589-26ec86ab4eef tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1722 microversion: 2.20 time: 0.151612 Oct 12 00:23:40.739237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 221/455] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:40 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:41.459749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:41.461907 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:41.467923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:41.468399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:41.468829 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:41.469513 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:41.469963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:41.470384 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:41.500358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-db8155a4-f521-4c79-abee-00c4e231c04f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Oct 12 00:23:41.500904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 235/456] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:23:41 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:41.764690 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:41.765250 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:41.771654 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:41.772127 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:41.772554 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:41.773231 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:41.773670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:41.774084 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:41.902459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:41.910510 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:41.911980 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:41.913157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-15bf080d-7139-4438-9029-de933674a726 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1722 microversion: 2.20 time: 0.152741 Oct 12 00:23:41.913715 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 222/457] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:41 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:42.512595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:42.514719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:42.520470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:42.520940 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:42.521363 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:42.522050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:42.522478 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:42.522891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:42.552500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5259f331-e791-4019-87ed-e6d1b690498d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044497 Oct 12 00:23:42.553058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 236/458] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:23:42 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:42.850640 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:42.852523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:42.857692 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:42.858174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:42.858607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:42.859352 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:42.859828 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:42.860250 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:42.938648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:42.939455 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:42.941377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'services' on Instance uuid 1a130e92-2fae-45a7-a64c-bffbf46b4758 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:42.945878 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:42.946422 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:42.946992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:42.948313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:42.948816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:42.949298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:43.083928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:43.091823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:43.093247 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:43.094421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8b2e8b67-3fce-4ec4-b860-2d83b7aa26bb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1722 microversion: 2.20 time: 0.159648 Oct 12 00:23:43.094961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 237/459] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:42 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:43.158365 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6f783b13-0f7a-4f1e-8584-5994a1d926a9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/os-volume_attachments/6c540623-6fbf-4c0c-a6dc-e5916769e96e" status: 202 len: 0 microversion: 2.1 time: 0.311504 Oct 12 00:23:43.161647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 223/460] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:23:42 2022] DELETE /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/os-volume_attachments/6c540623-6fbf-4c0c-a6dc-e5916769e96e => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:23:43.564906 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:43.567053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:43.573123 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:43.573599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:43.574030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:43.574721 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:43.575172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:43.575614 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:43.605359 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ce60f838-9b45-4cc2-a17a-6a75368af6b7 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Oct 12 00:23:43.605922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 238/461] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:23:43 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:23:44.121460 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:44.122147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:44.128297 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:44.128767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:44.129192 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:44.129869 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:44.130312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:44.130728 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:44.264823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:44.274341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:44.275849 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:44.277370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-72639101-9780-48bb-acf6-b8578fc28a25 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1725 microversion: 2.20 time: 0.161182 Oct 12 00:23:44.277998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 224/462] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:44 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:44.305646 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a74eed5e-81cc-40e3-a3d6-a0ef44cff59c"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:44.308718 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:44.314787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:44.315273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:44.315775 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:44.316520 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:44.317082 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:44.317516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:44.620463 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:44.622798 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:44.628877 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:44.629561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:44.629998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:44.630930 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:44.631585 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:44.632008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:44.661787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4adc5e90-2942-4b65-98ba-d9e4bebaca00 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047807 Oct 12 00:23:44.662348 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 225/463] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:23:44 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:23:45.310571 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:45.376402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-555b5204-6ab2-4ee7-b922-526adf011628 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.074930 Oct 12 00:23:45.377279 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 239/464] 10.222.0.36 () {62 vars in 1364 bytes} [Wed Oct 12 00:23:44 2022] POST /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments => generated 188 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:23:45.452267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:45.455465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:45.464829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.465347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.466242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.466851 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.467505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.467930 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.495452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lazy-loading 'flavor' on Instance uuid 8894cbf9-861b-4b92-90ee-00bbe2777303 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:45.529995 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:45.530590 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:45.537927 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.538412 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.538846 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.546560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.547064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.547539 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.593729 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125810) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 00:23:45.809385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6b61b1d3-9bfd-43bb-8eb1-7fd5a6cb9ddc tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/action" status: 200 len: 32 microversion: 2.1 time: 0.361344 Oct 12 00:23:45.810023 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 226/465] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:23:45 2022] POST /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:23:45.815691 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:45.818213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:45.825341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.826046 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.826532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.827208 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.827688 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.828270 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.856140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6c072626-e6cd-45bf-b1de-da83cae6b968 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/action" status: 202 len: 0 microversion: 2.20 time: 0.330636 Oct 12 00:23:45.856820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 240/466] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Oct 12 00:23:45 2022] POST /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 00:23:45.860817 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ac481f77-998c-4efb-b5b3-961437079923 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049418 Oct 12 00:23:45.861400 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 227/467] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:23:45 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:45.862009 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:45.862788 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:45.869007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.869425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:45.869554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.870547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:45.870628 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.870779 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.871915 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.872412 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.876500 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.877050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.877420 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:45.878123 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:45.878572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:45.879002 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:46.051255 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:46.058200 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:46.063393 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:46.064876 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:46.067457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9310f7e9-0645-4090-a5fb-9feeea4c2011 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1751 microversion: 2.20 time: 0.205069 Oct 12 00:23:46.068201 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 228/468] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:45 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:46.084025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3f16060f-466a-4cfb-875f-777939d4a9a5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.210607 Oct 12 00:23:46.084842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 241/469] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:45 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:46.874541 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:46.876717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:46.882677 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:46.883160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:46.883825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:46.884632 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:46.885003 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:46.885487 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:46.917178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-609488df-ed11-44fe-9c15-93027211e208 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047644 Oct 12 00:23:46.917663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 229/470] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:23:46 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:23:46.982507 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:46.983001 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:46.990830 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:46.991317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:46.991769 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:46.992663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:46.993105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:46.993518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.016154 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:47.016712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:47.022597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:23:47.023310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.023857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.024328 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.025048 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.025701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.026141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.118105 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lazy-loading 'services' on Instance uuid fff79ad8-fc4e-4a17-930a-6e1e1344e251 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:47.368718 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e1440856-3532-40f8-9701-622f7d6b5499 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 204 len: 0 microversion: 2.1 time: 0.390256 Oct 12 00:23:47.369888 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 242/471] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:23:46 2022] DELETE /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:23:47.373354 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a5899572-bbdf-44d5-8ce1-ee411d85a657 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251/os-volume_attachments/e4ac92dd-506d-4870-bea0-da98156f34f0" status: 202 len: 0 microversion: 2.1 time: 0.361109 Oct 12 00:23:47.373940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 230/472] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:23:47 2022] DELETE /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251/os-volume_attachments/e4ac92dd-506d-4870-bea0-da98156f34f0 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 00:23:47.375436 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:47.376130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:47.382163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:47.382391 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.382873 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.383159 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:47.383300 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.384075 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.384526 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.385043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.390303 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.390856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.391356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.392133 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.392643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.393124 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.531513 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:47.534719 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:47.542195 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:47.543714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:47.544881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2330948a-608c-4d95-b94f-495b7329122e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1751 microversion: 2.20 time: 0.173710 Oct 12 00:23:47.545432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 243/473] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:47 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:47.546029 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e13bd992-2b9d-4dd0-83e3-ca6755cd8978 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.169648 Oct 12 00:23:47.546596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 231/474] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:47 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:47.550837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:47.551132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f9e2f503-3dce-475c-ae12-a04dcab80fce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:47.555805 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:47.557309 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9e2f503-3dce-475c-ae12-a04dcab80fce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.557601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.557797 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9e2f503-3dce-475c-ae12-a04dcab80fce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.558082 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.558228 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9e2f503-3dce-475c-ae12-a04dcab80fce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.558573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.559266 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.559905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.560335 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.561930 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:47.586780 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f9e2f503-3dce-475c-ae12-a04dcab80fce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Going to try to stop instance {{(pid=125809) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 00:23:47.690240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:47.697864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d8264cc1-41d1-4e10-b5e8-b6934cfc31be tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1679 microversion: 2.1 time: 0.151079 Oct 12 00:23:47.698423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 244/475] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:47 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:47.750334 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f9e2f503-3dce-475c-ae12-a04dcab80fce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/action" status: 202 len: 0 microversion: 2.1 time: 0.202479 Oct 12 00:23:47.753716 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 232/476] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:23:47 2022] POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:23:47.758673 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:47.759274 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:47.765941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.766410 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.766834 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.767551 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:47.768040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:47.768461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:47.897241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:47.905790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ae96b57b-6159-42e7-aa0d-2f71417a75dd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.150763 Oct 12 00:23:47.906635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 245/477] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:47 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:48.585682 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:48.586338 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:48.586724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:48.586826 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:48.593020 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:48.593506 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:48.593618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:48.593975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:48.594074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:48.594453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:48.594679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:48.595135 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:48.595244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:48.595611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:48.595754 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:48.596035 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:48.730004 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:48.735853 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:48.739347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:48.740825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:48.741988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-45b8a2c5-6abf-4a5a-8965-0b442254dc08 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1751 microversion: 2.20 time: 0.161234 Oct 12 00:23:48.742590 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 233/478] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:48 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:48.744105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ce09b547-f212-4bda-a7fc-a349d5758fab tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.162179 Oct 12 00:23:48.745122 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 246/479] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:48 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:48.747002 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:48.747627 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:48.753760 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:48.754510 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:48.755060 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:48.755957 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:48.756555 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:48.757076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:48.882984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:48.891206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-998443c6-0c91-4ecf-b662-e8cca20f1f1e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1679 microversion: 2.1 time: 0.147655 Oct 12 00:23:48.891805 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 234/480] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:48 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:48.928519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:48.929121 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:48.935141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:48.935663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:48.936101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:48.936824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:48.937274 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:48.937697 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:49.066685 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:49.074925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9be212e5-e4b7-4bd7-a327-b7ccf0963863 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.150221 Oct 12 00:23:49.075516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 247/481] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:48 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:49.767036 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:49.767697 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:49.768676 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:49.769277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:49.774147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:49.774631 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:49.775067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:49.775187 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:49.775677 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:49.775806 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:49.776101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:49.776268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:49.776649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:49.776764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:49.777213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:49.777622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:49.911013 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:49.913016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:49.920586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:49.921714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d048d3cd-8c3e-4233-93aa-3ec5b4f2c0a3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.157213 Oct 12 00:23:49.922226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:49.922360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 248/482] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:49 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:49.923504 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d012b760-5fe3-4561-9c64-d46396f3247b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1753 microversion: 2.20 time: 0.160289 Oct 12 00:23:49.924146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 235/483] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:49 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:49.929056 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:49.929056 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:49.932923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:49.934377 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:49.934972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:49.935689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:49.936142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:49.936567 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:50.059880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:50.067547 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-58f63235-b922-44db-a0cb-157c00106e2a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1679 microversion: 2.1 time: 0.144319 Oct 12 00:23:50.068111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 249/484] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:49 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:50.097830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:50.098432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:50.104532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:50.105011 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:50.106074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:50.106760 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:50.107208 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:50.107665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:50.232132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:50.239835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-96132c9f-5dd9-48d2-8d68-67ec439b75e8 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.145768 Oct 12 00:23:50.240406 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 236/485] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:50 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:50.944957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:50.945648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:50.950267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:50.950874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:50.957777 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:50.958382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:50.958898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:50.959709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:50.960592 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:50.961111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:50.961242 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:50.961544 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:50.964423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:50.964704 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:50.970924 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:50.971427 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:51.113878 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:51.123186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:51.124784 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:51.126026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4f38ce20-8708-425a-b3a4-cdfd53253d72 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1753 microversion: 2.20 time: 0.180357 Oct 12 00:23:51.126677 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 237/486] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:50 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:51.143012 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:51.143727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:51.149764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:51.150178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:51.150605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:51.151289 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:51.151755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:51.152168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:51.186068 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:51.195466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-83b27b6f-c612-4191-be88-202eaa64dd6e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.254598 Oct 12 00:23:51.196119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 250/487] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:50 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:51.216613 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:51.224779 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2fa91fcf-f81a-4276-8937-e2e54f1b4d4d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1612 microversion: 2.1 time: 0.097067 Oct 12 00:23:51.225367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 238/488] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:51 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1612 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:51.262738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:51.263561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:51.269785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:51.270453 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:51.270987 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:51.271891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:51.272447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:51.273109 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:51.297692 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-2309662b-7765-4b3b-af42-8fcf8e4e62bb req-8aa6d050-23bf-45d8-b4cd-d933f6acd4f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d5f38e-5fbf-4a54-adf9-6025f1358776", "name": "network-vif-deleted", "tag": "25ead2ef-e264-4674-985a-3ce94c8b6181"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:51.307703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2309662b-7765-4b3b-af42-8fcf8e4e62bb req-8aa6d050-23bf-45d8-b4cd-d933f6acd4f1 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:51.308199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2309662b-7765-4b3b-af42-8fcf8e4e62bb req-8aa6d050-23bf-45d8-b4cd-d933f6acd4f1 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:51.309236 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2309662b-7765-4b3b-af42-8fcf8e4e62bb req-8aa6d050-23bf-45d8-b4cd-d933f6acd4f1 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:51.325774 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-2309662b-7765-4b3b-af42-8fcf8e4e62bb req-8aa6d050-23bf-45d8-b4cd-d933f6acd4f1 service nova] Creating event network-vif-deleted:25ead2ef-e264-4674-985a-3ce94c8b6181 for instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 on hv-cinder-84914 Oct 12 00:23:51.331335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-2309662b-7765-4b3b-af42-8fcf8e4e62bb req-8aa6d050-23bf-45d8-b4cd-d933f6acd4f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037162 Oct 12 00:23:51.332067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 239/489] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:23:51.432044 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:51.441147 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bf722048-52e4-4105-bcce-9077d3252250 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.182874 Oct 12 00:23:51.456807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 251/490] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:51 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:51.674553 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:51.675077 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:51.681251 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:51.681741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:51.682359 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:51.687244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:51.687244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:51.687244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:51.709896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:23:51.999315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-18f619dd-e645-4ff9-9ad2-0a1e2f920a8f tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 204 len: 0 microversion: 2.1 time: 0.328786 Oct 12 00:23:51.999966 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 240/491] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:23:51 2022] DELETE /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:23:52.013152 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:52.013152 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:52.017003 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.017499 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.017934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.018667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.019124 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.019637 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.154136 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:52.154943 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:52.161885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:52.164119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.164617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.165055 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.165763 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.166221 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.166675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.173497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a023841e-74cd-4a4d-a999-a518cfc6954c tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1513 microversion: 2.1 time: 0.169278 Oct 12 00:23:52.174075 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 252/492] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:52 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:52.220350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:52.221151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:52.228324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.228983 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.229561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.230412 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.230964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.231589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.307895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:52.316936 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:52.318364 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:52.319632 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5973aecf-1d61-4725-aec1-e14a2c900afb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1753 microversion: 2.20 time: 0.170596 Oct 12 00:23:52.320196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 241/493] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:52 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:52.325299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:52.325890 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:52.332205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.332788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.333349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.334041 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.334483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.334905 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.366981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.367485 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.367934 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.368390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 84d5f38e-5fbf-4a54-adf9-6025f1358776 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:52.382406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:52.385943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:52.392169 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7f19fca5-9bb8-48ec-8e24-55281636a155 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.176156 Oct 12 00:23:52.392743 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 253/494] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:52 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:52.413658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:52.421649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-27e683a1-3b3a-4c30-afc7-5f23ca05e836 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1330 microversion: 2.1 time: 0.100512 Oct 12 00:23:52.422298 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 242/495] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:52 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:52.463932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:52.464489 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:52.471066 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.471572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.471998 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.472694 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:52.473140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:52.473553 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:52.601904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:52.610163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9968c5d6-226c-46e0-ae7d-b1d0216aa502 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.150155 Oct 12 00:23:52.610732 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 254/496] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:52 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:53.196700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:53.197339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:53.203830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.204307 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.204740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.205450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.205897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.206323 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.333507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:53.341612 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7530a336-ebc3-459e-8fa7-6a007149a05e tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1513 microversion: 2.1 time: 0.148834 Oct 12 00:23:53.342176 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 243/497] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:53 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:53.345950 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:53.346693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:53.352842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.353311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.353735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.354414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.354854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.355845 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.415568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:53.416174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:53.422398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.422869 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.423331 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.424034 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.424481 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.424901 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.488996 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:53.497594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:53.499028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:53.500236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ce3d5737-c5a3-4143-81ef-550b06699131 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1753 microversion: 2.20 time: 0.158431 Oct 12 00:23:53.500795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 255/498] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:53 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:53.507391 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:53.508098 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:53.514795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.515280 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.515738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.516437 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.516891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.517312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.548641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.549117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.549551 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.550066 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 84d5f38e-5fbf-4a54-adf9-6025f1358776 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:53.556392 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:53.564833 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-274ecb39-48ab-4d8f-9c93-18b1c0d9e180 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.153143 Oct 12 00:23:53.565401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 244/499] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:53 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:53.591687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:53.599496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-782cb5a6-7065-4a36-ae82-0486ce290472 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1330 microversion: 2.1 time: 0.096040 Oct 12 00:23:53.600059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 256/500] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:53 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:53.634069 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:53.634670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:53.641745 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.642241 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.642670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.643348 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:53.643816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:53.644262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:53.775878 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:53.784087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-409afce4-0be1-4148-89e8-891eee8e6793 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.153855 Oct 12 00:23:53.784652 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 245/501] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:53 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:54.364867 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:54.365479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:54.372334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.372815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.373245 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.374014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.374464 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.374959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.502644 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:54.510340 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2397717b-f52c-43ed-b151-ee7dc50cd7e6 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1513 microversion: 2.1 time: 0.149299 Oct 12 00:23:54.510903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 257/502] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:54 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:54.525678 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:54.526284 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:54.532735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.533255 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.533679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.534392 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.534836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.535253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.554209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:54.588797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:54.589954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:54.595949 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.596465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.596868 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.597557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.598011 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.598432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.667511 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:54.676953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:54.678394 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:54.679664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8b9c36f3-f756-481b-8eee-164a70b122d3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1753 microversion: 2.20 time: 0.157710 Oct 12 00:23:54.680247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 246/503] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:54 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:54.692907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:54.692907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:54.692907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.692907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.693238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.693238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.693370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.694183 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.726202 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.726684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.727121 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.727595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 84d5f38e-5fbf-4a54-adf9-6025f1358776 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:54.731511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:54.741049 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c49c0e33-e847-48f7-a78e-fc374ee8c761 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.156223 Oct 12 00:23:54.741633 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 258/504] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:54 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:54.768186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:54.775890 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bbf9f87d-a274-4398-8f2b-8e275d7b454f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 200 len: 1330 microversion: 2.1 time: 0.094712 Oct 12 00:23:54.776455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 247/505] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:54 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:54.805893 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:54.806494 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:54.812441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.812915 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.813338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:54.814016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:54.814459 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:54.814871 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.038517 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:55.056640 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-19bdd784-056e-4738-9d54-a69de6ea48c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.254409 Oct 12 00:23:55.057252 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 259/506] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:54 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:55.474123 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-45bf0963-ad60-4e27-8f99-654e14e11111 req-5c384efd-3e5b-44a3-b2ec-ae32641d9f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fff79ad8-fc4e-4a17-930a-6e1e1344e251", "name": "network-vif-deleted", "tag": "dbb99aba-88ee-4441-85ff-aef564d9b583"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:55.486574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-45bf0963-ad60-4e27-8f99-654e14e11111 req-5c384efd-3e5b-44a3-b2ec-ae32641d9f85 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.486574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-45bf0963-ad60-4e27-8f99-654e14e11111 req-5c384efd-3e5b-44a3-b2ec-ae32641d9f85 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.486574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-45bf0963-ad60-4e27-8f99-654e14e11111 req-5c384efd-3e5b-44a3-b2ec-ae32641d9f85 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.496431 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-45bf0963-ad60-4e27-8f99-654e14e11111 req-5c384efd-3e5b-44a3-b2ec-ae32641d9f85 service nova] Creating event network-vif-deleted:dbb99aba-88ee-4441-85ff-aef564d9b583 for instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 on hv-cinder-84914 Oct 12 00:23:55.501396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-45bf0963-ad60-4e27-8f99-654e14e11111 req-5c384efd-3e5b-44a3-b2ec-ae32641d9f85 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031377 Oct 12 00:23:55.501986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 248/507] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:55.533177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:55.533806 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:55.543416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.543416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.543416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.543416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.544444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.544444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.617178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:55.626854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9bb40424-a1c3-4d44-b901-e93c70fc003a tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1471 microversion: 2.1 time: 0.097892 Oct 12 00:23:55.628974 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 260/508] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:55 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1471 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:55.707060 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:55.707756 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:55.714085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.715100 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.715603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.716361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.716839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.717226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.765119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:55.765716 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:55.771785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.772296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.772724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.773417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.773860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.774322 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.856097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:55.864831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:55.866267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:55.867518 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0c5b6672-3a6c-4b42-a1ca-3e8c62c3f9cc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.165238 Oct 12 00:23:55.868078 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 249/509] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:55 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:55.872791 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:55.873391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:55.879071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.881505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.881505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.881505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:55.881505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:55.881885 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:55.895745 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 HTTP/1.1 Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:23:55.897363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:23:55.898895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '84d5f38e-5fbf-4a54-adf9-6025f1358776'} Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:23:55.899839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:23:55.901257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:23:55.903171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:23:55.903171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-50a48e35-9580-47c0-916c-6cefb7cac218 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 404 len: 111 microversion: 2.1 time: 0.029734 Oct 12 00:23:55.903171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 250/510] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:55 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:23:55.906462 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:55.911567 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b4133f45-2f1b-4ef9-81b1-3f8c6601e127 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '.version_select at 0x7f2fe9c9e940>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:55.914788 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9489a009-5b56-4601-b76f-5e6ea1ccb15a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.154556 Oct 12 00:23:55.915347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 261/511] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:55 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:55.982432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b4133f45-2f1b-4ef9-81b1-3f8c6601e127 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-212682822" status: 202 len: 0 microversion: 2.1 time: 0.074368 Oct 12 00:23:55.982920 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 251/512] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Oct 12 00:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-212682822 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 00:23:56.080755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:56.081386 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:56.088164 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.090062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.090062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:56.091127 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.091758 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.092332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:56.272138 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:56.281489 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0044f5c2-15e5-43d9-9627-cdc6eba90d7f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.204146 Oct 12 00:23:56.282825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 262/513] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:56 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:56.650739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:56.651341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:56.658556 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.659033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.659577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:56.660238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.660686 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.661103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:56.690317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.690782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.691211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:56.691739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lazy-loading 'fault' on Instance uuid fff79ad8-fc4e-4a17-930a-6e1e1344e251 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:23:56.760402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0791b4507cf48bca517f41f0feebd78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4194baa4b1fe4ab2840720dbf012a2f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:56.771995 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-803d1ff7-08c7-4a7a-b5f9-7e97bdf7896b tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 200 len: 1309 microversion: 2.1 time: 0.124856 Oct 12 00:23:56.774244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 252/514] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:56 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:56.848728 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ada7b067-cdb0-4b43-9e85-35e58a9ce907 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: .version_select at 0x7f2fe8e710d0>, body: {"keypair": {"name": "tempest-keypair-609081507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB00oF060oc2XdV4T7Df/3YhIgHNtyFCAfviVALcH2XqZINQlWoEiP8tyyB/7crBi9HsDOXXcVz9vfkoCSE8LVi6n0Gn9GA1aBHXAp0gWxp6HgmRaJ2s2oK5YsmZm6U9Jw=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:56.864234 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-ada7b067-cdb0-4b43-9e85-35e58a9ce907 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for project 10160596b45c49249155b0c2585e70bb. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:23:56.868010 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-ada7b067-cdb0-4b43-9e85-35e58a9ce907 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for user de766cb582ba4c18b1fda9bf4ad43f65 and project 10160596b45c49249155b0c2585e70bb. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:23:56.893582 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:56.894175 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:56.896330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:56.900985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.901462 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.901928 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:56.902666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.903119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.903573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:56.965376 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ada7b067-cdb0-4b43-9e85-35e58a9ce907 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120097 Oct 12 00:23:56.967106 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 263/515] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:23:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:23:56.979941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:56.980569 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:56.988693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.989443 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.990055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:56.990935 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:56.991575 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:56.992176 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:57.065920 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:57.076413 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:57.078087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:57.079507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7afb9ad9-0c0f-4168-8958-f8962202f710 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.189724 Oct 12 00:23:57.080161 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 253/516] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:56 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:23:57.134444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:57.143014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a7edf078-c607-4e28-93e3-e78490552a8a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.167429 Oct 12 00:23:57.143795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 264/517] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:56 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:57.305283 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:57.305892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:57.312671 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:57.313147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:57.313580 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:57.314265 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:57.314717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:57.315138 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:57.688954 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:57.697946 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a9774bf1-b943-4c85-8ce6-7dbedcc69752 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.396964 Oct 12 00:23:57.711693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 254/518] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:57 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:57.797390 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:57.798092 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] [instance: fff79ad8-fc4e-4a17-930a-6e1e1344e251] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:57.808721 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:57.809629 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:57.810232 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:57.812287 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:57.813508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:57.816049 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:57.835142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] HTTP exception thrown: Instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 could not be found. Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Request method failure captured: Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 HTTP/1.1 Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgiIhu52WQix4dWxRFP8iBFPpBywm5faCoBPN83iaOms6HBhg3pBniuVlYQ1g9OXf9Usc7r1hE88nP2FPeDt9JJcP2BKWXkU_5ImvBTN0AKD3IosbcKdtbd7-CnhFHYv52AIh_QjMHO3Jc8ITCGhVAfaXAP0nD3zTQM_84o1sxXwSow Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 4194baa4b1fe4ab2840720dbf012a2f3 Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1731173328 Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:23:57.837104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_4194baa4b1fe4ab2840720dbf012a2f3", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4194baa4b1fe4ab2840720dbf012a2f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/4194baa4b1fe4ab2840720dbf012a2f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/4194baa4b1fe4ab2840720dbf012a2f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesSnapshotTestJSON-1731173328 Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 4194baa4b1fe4ab2840720dbf012a2f3 Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1731173328 Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesSnapshotTestJSON-1731173328-project Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: b0791b4507cf48bca517f41f0feebd78 Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesSnapshotTestJSON-1731173328-project Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 could not be found. Oct 12 00:23:57.838537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'fff79ad8-fc4e-4a17-930a-6e1e1344e251'} Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 could not be found. Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:23:57.840059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 could not be found. Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 could not be found. Oct 12 00:23:57.847807 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:23:57.849424 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] Returning 404 to user: Instance fff79ad8-fc4e-4a17-930a-6e1e1344e251 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:23:57.849424 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-55396e8d-a0eb-4d10-ba0b-c6a643b43063 tempest-VolumesSnapshotTestJSON-1731173328 tempest-VolumesSnapshotTestJSON-1731173328-project] 10.222.0.36 "GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251" status: 404 len: 111 microversion: 2.1 time: 0.045624 Oct 12 00:23:57.849424 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 265/519] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:57 2022] GET /compute/v2.1/servers/fff79ad8-fc4e-4a17-930a-6e1e1344e251 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:23:58.106116 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:58.106707 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:58.126428 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.126428 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.126428 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.126428 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.126914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.126914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.166761 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:58.168052 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:58.175561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.176090 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.176581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.177396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.178252 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.178936 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.364056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:58.375678 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:58.377221 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:58.378467 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-03f8f46e-6f83-4f5e-95ce-af620562466f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.277408 Oct 12 00:23:58.379421 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 255/520] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:58 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:23:58.406889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:58.416790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aee518c7-5b8a-4cc1-92ea-40302bfa0e13 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.254172 Oct 12 00:23:58.417991 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 266/521] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:58 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:58.561423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:23:58.563986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:58.571085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.575229 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.575229 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.575229 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.575229 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.575625 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.734487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:58.737906 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:58.749527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:23:58.751360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.752050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.752635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.753719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.754342 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.755661 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.818914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f1f5eaf0-d421-48b3-9d54-eec3dea03f21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "POST /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/action" status: 202 len: 0 microversion: 2.1 time: 0.269019 Oct 12 00:23:58.822563 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 256/522] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:23:58 2022] POST /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:23:58.836153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:58.837129 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:58.846814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.847589 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.848368 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.849310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:58.850181 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:58.850619 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:58.952616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:58.976376 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1175c6a6-4fc1-4b2f-9ade-c5ecd40d05a7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.259127 Oct 12 00:23:58.981278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 267/523] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:58 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:23:59.129436 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:59.145517 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6ec530a3-b41b-44c7-8fbb-8d6d23b11c6c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.319901 Oct 12 00:23:59.149111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 257/524] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:58 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:59.411007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:59.411007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:59.430909 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:59.431903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:59.432503 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:59.433458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:59.434076 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:59.434660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:59.447046 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:23:59.449264 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:23:59.459131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:59.459640 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:59.460069 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:59.460770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:23:59.461213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:23:59.461630 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:23:59.636808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:59.646207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:59.646369 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:59.647691 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:23:59.648866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-325b345b-343b-48c3-82df-cb3edd6f45ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.246061 Oct 12 00:23:59.661538 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9c3cbdb9-0e50-4aaa-85ff-1e0e077e8da7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.219423 Oct 12 00:23:59.663176 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 258/525] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:59 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:23:59.687519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 268/526] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:23:59 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:00.003949 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:00.005101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:00.013703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:00.014825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:00.015602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:00.016790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:00.017656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:00.018293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:00.173018 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:00.173578 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:00.180027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:00.180510 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:00.180936 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:00.181640 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:00.182086 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:00.183641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:00.294812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:00.303906 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c4b32297-bd01-4c59-9bce-b833cd441080 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.304070 Oct 12 00:24:00.310528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 259/527] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:23:59 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:00.389511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:00.399070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-706d6df9-bda5-4584-89ff-38ef80e80f5f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.230279 Oct 12 00:24:00.402409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 269/528] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:00 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:00.683916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-501209103", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7f2d8cc-4d82-4295-a149-404a55bcd20c"}], "security_groups": [{"name": "tempest-securitygroup--841771888"}], "key_name": "tempest-keypair-609081507", "user_data": "}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:00.689590 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:00.690203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:00.700329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:00.701332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:00.701764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:00.702588 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:00.703128 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:00.703667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:00.829125 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] validate_networks() for [('a7f2d8cc-4d82-4295-a149-404a55bcd20c', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:24:00.868599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:00.878485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ea846071-90ea-4158-96ea-84020c8cc46b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.192850 Oct 12 00:24:00.885399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 270/529] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:00 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:00.890732 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:00.891338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:00.897867 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:00.898462 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:00.898986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:00.899804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:00.900349 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:00.900858 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:01.065147 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:01.068711 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:01.075116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:01.076576 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:01.082795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-475ceabb-4da9-48c2-9e1f-8b9ca5524c97 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.190767 Oct 12 00:24:01.082795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 271/530] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:00 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:01.278516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:24:01.278937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:24:01.279524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:24:01.279833 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:24:01.280233 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:24:01.294322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:01.295498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:01.296129 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:01.296910 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:01.297597 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:01.298087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:01.316260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for project 10160596b45c49249155b0c2585e70bb. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:24:01.321014 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for user de766cb582ba4c18b1fda9bf4ad43f65 and project 10160596b45c49249155b0c2585e70bb. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:24:01.333923 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:24:01.336445 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:01.336945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:24:01.337334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:01.347201 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:01.347926 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:01.348325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:01.349197 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:01.349666 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:01.350158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:01.458924 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c18cf226-cabf-46bb-9c0c-1a5c20331dc4 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.779808 Oct 12 00:24:01.459759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 260/531] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:24:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:24:01.471054 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:01.471848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:01.478180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:01.479275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:01.480423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:01.480423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:01.481123 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:01.481660 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:01.500971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:01.512159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b8945fee-fd8b-405a-9140-83e27e251688 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.178978 Oct 12 00:24:01.512824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 272/532] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:01 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:01.520619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8d66be6c-6da6-4ec6-94ca-684b76b6a880 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:01.521223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8d66be6c-6da6-4ec6-94ca-684b76b6a880 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:01.576249 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8d66be6c-6da6-4ec6-94ca-684b76b6a880 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:01.583233 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8d66be6c-6da6-4ec6-94ca-684b76b6a880 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1240 microversion: 2.1 time: 0.066321 Oct 12 00:24:01.584014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 273/533] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:01 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:01.664430 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:01.673853 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-77cc665b-4ffa-494f-adcc-4eea054b0d76 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.206708 Oct 12 00:24:01.674832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 261/534] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:01 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:01.913313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:01.913993 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:01.920184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:01.920897 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:01.921512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:01.922403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:01.923019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:01.923624 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.085653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:02.095186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c4aa4f34-909f-4a11-8038-fb11b2dede79 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.185723 Oct 12 00:24:02.096197 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 274/535] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:01 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:02.115214 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:02.116098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:02.123759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:02.124334 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:02.124837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.125649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:02.126160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:02.126608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.281828 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:02.291443 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:02.294226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:02.294226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-964f5b32-cb05-4b58-bfe8-fe55ecfd84d2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.192045 Oct 12 00:24:02.308271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 262/536] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:02 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:24:02.534324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:02.534999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:02.541591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:02.542665 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:02.543444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.543978 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:02.544636 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:02.545053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.607686 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:02.608204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:02.615096 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:02.615767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:02.616208 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.616904 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:02.617353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:02.617772 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.680531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:02.685241 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:02.691434 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cf247be5-2fcf-46af-856d-5a6ffc614954 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.160834 Oct 12 00:24:02.694531 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-09869e0e-65a8-4445-8ff6-9c113b4d8f19 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1244 microversion: 2.1 time: 0.091282 Oct 12 00:24:02.695294 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 263/537] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:02 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:02.700320 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:02.701088 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:02.707230 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:02.707747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:02.708291 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.708985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:02.709426 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:02.709873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:02.711578 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 275/538] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:02 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:02.729185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:02.873182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:02.882238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-963779d4-3111-4604-be9e-b5f86c611da5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.185667 Oct 12 00:24:02.882820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 264/539] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:02 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:03.118751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:03.119816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:03.126495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.127497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.128116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.128992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.129475 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.129894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.274560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:03.283339 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a7148f43-4fd2-4b43-8ffe-bef006bb8abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.169076 Oct 12 00:24:03.283979 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 276/540] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:03 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:03.319793 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:03.320555 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:03.329042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.329042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.330090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.330806 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.331262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.331726 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.499358 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:03.508085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:03.509524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:03.511542 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bc3020cd-83a4-4d13-bbc5-1802b4c3991a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.194772 Oct 12 00:24:03.512105 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 265/541] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:03 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:03.714074 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:03.714660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:03.718959 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:03.719767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:03.720789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.721271 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.721705 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.722397 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.722849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.723269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.725713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.726187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.726612 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.727498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.727948 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.728366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.793681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:03.801758 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9ec77f78-7413-4c5c-a4b5-e752bff0df77 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1244 microversion: 2.1 time: 0.086333 Oct 12 00:24:03.810678 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 266/542] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:03 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:03.860714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:03.868678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-294fd966-5243-45b5-928d-fd82f1e17448 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.158420 Oct 12 00:24:03.872642 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 277/543] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:03 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:03.906549 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:03.907507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:03.913863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.914578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.915220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:03.916328 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:03.916979 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:03.917825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.069644 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:04.080190 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e9611c15-0b2a-4478-b293-3d87373ed9af tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.177381 Oct 12 00:24:04.080920 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 267/544] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:03 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:04.306646 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:04.307175 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:04.313972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:04.314454 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:04.314884 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.315617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:04.316067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:04.316486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.483953 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:04.492098 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b42b9a53-0d18-439b-ac37-e45b0ba03c78 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.189370 Oct 12 00:24:04.492656 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 278/545] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:04 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:04.538597 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:04.540214 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:04.549341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:04.550193 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:04.550798 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.551553 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:04.552066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:04.552490 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.709782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:04.719538 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:04.721353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:04.722608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a1da10ec-e013-4c82-a1a4-081c66e8526b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.188496 Oct 12 00:24:04.723184 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 268/546] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:04 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:04.825525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:04.826216 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:04.833349 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:04.834087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:04.834521 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.835393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:04.835877 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:04.836302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.896717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:04.897316 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:04.904118 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:04.904706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:04.905082 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.905832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:04.906280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:04.906696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:04.918556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:04.930006 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e53c3831-48e7-47f4-a4c5-04134c7021f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1244 microversion: 2.1 time: 0.108842 Oct 12 00:24:04.931178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 279/547] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:04 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1244 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:05.064663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:05.077514 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-07093285-b176-4e6e-bcc0-76404f2b3daf tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.183122 Oct 12 00:24:05.095416 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 269/548] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:04 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:05.103692 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:05.105249 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:05.112708 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:05.116299 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:05.117183 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:05.118428 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:05.119050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:05.119759 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:05.308269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:05.319275 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0d5fe6b6-976f-4f99-bd14-aa0af106ce21 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.219115 Oct 12 00:24:05.326951 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 280/549] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:05 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:05.516999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:05.517609 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:05.523935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:05.524422 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:05.524854 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:05.525559 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:05.526010 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:05.527068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:05.669651 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:05.679165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d7f8b94d-5713-4d26-85bb-7750d54252cd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.166193 Oct 12 00:24:05.680094 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 270/550] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:05 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:05.752860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:05.753383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:05.759324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:05.759835 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:05.760266 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:05.761714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:05.762162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:05.762581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:05.897439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:05.906872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:05.908490 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:05.909976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4484ca08-e600-42b5-bc92-c769cb899362 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.161022 Oct 12 00:24:05.911302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 281/551] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:05 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:05.954588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:05.955193 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:05.961337 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:05.963272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:05.963272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:05.963272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:05.963578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:05.963997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:06.026740 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:06.034525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0ec36928-9ded-4272-8705-1b66f1eb91e3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1244 microversion: 2.1 time: 0.084053 Oct 12 00:24:06.043215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 271/552] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:05 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:06.107286 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:06.107962 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:06.113984 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:06.114467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:06.114898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:06.115615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:06.116073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:06.116506 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:06.250360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:06.258743 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b6bd1e90-4b8c-4ffb-994f-a7e2e93f09e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1676 microversion: 2.1 time: 0.156461 Oct 12 00:24:06.259420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 282/553] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:06 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:06.344107 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:06.344829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:06.350700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:06.351172 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:06.351630 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:06.352311 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:06.352755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:06.353168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:06.509219 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:06.511785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2fe26b35-25f7-443a-b288-e3b45f20d275 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.170643 Oct 12 00:24:06.512717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 272/554] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:06 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:06.702755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:06.703374 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:06.709405 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:06.710055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:06.710572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:06.711265 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:06.711746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:06.712166 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:06.847227 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:06.857215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8312a598-8d66-4118-beb5-153ae5534d7f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.159003 Oct 12 00:24:06.857786 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 283/555] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:06 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:06.936315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:06.937052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:06.943566 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:06.944052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:06.948788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:06.948788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:06.948788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:06.948788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.062912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:07.062912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:07.074391 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.074874 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.075302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.076025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.076471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.076886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.092734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:07.103230 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:07.105288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:07.106537 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8856c6fe-51c4-4809-a2bf-4c173cf1793d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.174657 Oct 12 00:24:07.107091 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 273/556] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:06 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:07.149975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:07.157929 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-03ab441d-71ef-4901-aebc-dc9dfbf6d740 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1236 microversion: 2.1 time: 0.104185 Oct 12 00:24:07.158496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 284/557] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:07 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:07.282065 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:07.282689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:07.288677 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.289154 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.289585 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.290303 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.290753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.291174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.419888 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:07.427570 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6f877516-c708-43a9-ae68-bdf3a5df3362 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1653 microversion: 2.1 time: 0.149420 Oct 12 00:24:07.428129 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 274/558] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:07 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:07.449137 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0d5fcdaa-439c-45de-9b35-c666acce1c7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:07.454969 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fcdaa-439c-45de-9b35-c666acce1c7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.455467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fcdaa-439c-45de-9b35-c666acce1c7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.455895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d5fcdaa-439c-45de-9b35-c666acce1c7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.513692 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0d5fcdaa-439c-45de-9b35-c666acce1c7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Going to try to start instance {{(pid=125810) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 00:24:07.544074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:07.544678 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:07.552947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.552947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.552947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.552947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.553246 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.553365 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.703317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:07.711620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-92baf084-9669-41e9-86ae-70dce473ac56 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.171900 Oct 12 00:24:07.712187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 275/559] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:07 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:07.735990 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0d5fcdaa-439c-45de-9b35-c666acce1c7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/action" status: 202 len: 0 microversion: 2.1 time: 0.290403 Oct 12 00:24:07.736657 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 285/560] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:24:07 2022] POST /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:24:07.749136 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:07.749743 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:07.757423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.758131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.758741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.759672 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.761251 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.761838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.882435 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:07.883412 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:07.890493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.891038 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.891572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.892366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:07.892935 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:07.893424 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:07.904657 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:07.923059 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8320b501-8f5b-4af8-a1f5-c5c4f429fb02 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1662 microversion: 2.1 time: 0.177474 Oct 12 00:24:07.925174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 276/561] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:07 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1662 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:08.051859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:08.060229 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c38fc48a-5b1b-4be1-9998-3b2d53762eca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.182586 Oct 12 00:24:08.060798 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 286/562] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:07 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:08.132598 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:08.133299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:08.144188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:08.144188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:08.144188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:08.144188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:08.144853 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:08.144853 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:08.182757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:08.183522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:08.190531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:08.193402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:08.193402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:08.193402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:08.193402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:08.193796 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:08.256134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:08.264797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5281ed42-0796-4444-8355-7f7f2963ded8 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1292 microversion: 2.1 time: 0.086953 Oct 12 00:24:08.265366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 287/563] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:08 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:08.278564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:08.287234 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:08.288737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:08.289894 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7fa94aa8-a857-4fe5-8def-a71892dd4673 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.161245 Oct 12 00:24:08.290453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 277/564] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:08 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:08.736308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:08.736920 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:08.742935 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:08.743437 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:08.743873 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:08.744560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:08.745581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:08.746006 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:08.764839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:08.939211 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:08.945863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:08.946471 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:08.948393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-617ed71a-8a66-4c72-b2a9-2c8c1d29f09f tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.215971 Oct 12 00:24:08.948964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 288/565] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:08 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:08.952620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:08.953092 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:08.953516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:08.954202 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:08.954643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:08.955060 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:09.083471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:09.083963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:09.084121 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:09.091130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:09.091636 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:09.092074 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:09.092461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c8fa1a20-e5ed-417f-a19e-2309c026d04a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1662 microversion: 2.1 time: 0.150385 Oct 12 00:24:09.092767 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:09.093019 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 278/566] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:08 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:09.093221 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:09.093647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:09.221956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:09.230149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2000a302-5584-4eeb-b67f-b3b478a71f5c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.150487 Oct 12 00:24:09.230718 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 289/567] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:09 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:09.287532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:09.288135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:09.294448 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:09.294920 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:09.295347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:09.296104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:09.296551 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:09.297154 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:09.315405 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:09.316043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:09.321938 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:09.322387 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:09.323360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:09.324068 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:09.324517 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:09.324937 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:09.360596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:09.368633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e9469eb0-97c5-497e-83c2-dea8bbd22ebe tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1292 microversion: 2.1 time: 0.085013 Oct 12 00:24:09.369720 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 279/568] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:09 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:09.459178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:09.468538 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:09.470031 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:09.471172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7b90347c-5859-4331-950f-5d1dfc7ca14e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.159670 Oct 12 00:24:09.471773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 290/569] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:09 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:24:09.972143 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:09.972751 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:09.978608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:09.979681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:09.980113 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:09.980797 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:09.981245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:09.981670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.115987 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:10.116598 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:10.121505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:10.123130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:10.123654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:10.124087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.124786 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:10.125238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:10.125666 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.130698 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f8079543-46b0-4f4e-b579-c7c0a35d1bae tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.162343 Oct 12 00:24:10.131378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 280/570] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:09 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:10.250818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:10.253875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:10.254486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:10.258476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6e73f5f2-3a82-4366-95c1-06b275b4e235 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1662 microversion: 2.1 time: 0.146337 Oct 12 00:24:10.259071 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 291/571] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:10 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1662 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:10.260702 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:10.261349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:10.261777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.262473 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:10.262920 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:10.263344 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.267445 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=100 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:10.390098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:10.397565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:10.398166 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:10.398400 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5abd79bb-349b-4e05-abac-db19a0a16d51 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.148379 Oct 12 00:24:10.398977 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 281/572] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:10 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:10.407792 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:10.408269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:10.408699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.409377 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:10.409848 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:10.410373 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.472650 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:10.480718 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-763aea5c-ffb5-4338-8f63-5b54dcb9e0f3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1292 microversion: 2.1 time: 0.087124 Oct 12 00:24:10.481266 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 292/573] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:10 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:10.497147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:10.497757 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:10.503700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:10.504172 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:10.504602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.505283 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:10.505733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:10.506156 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:10.639832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:10.648341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:10.649777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:10.651559 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ed7db09a-43c4-4330-8260-fb8ffa9cceee tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.157742 Oct 12 00:24:10.652123 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 282/574] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:10 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:11.154627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:11.155353 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:11.161395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.161873 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.162300 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.162984 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.163463 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.163885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.281658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:11.282263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:11.288221 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.288691 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.289114 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.289796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.290241 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.290655 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.305727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:11.308368 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:11.316708 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-eb27484e-29ef-4d59-994c-9bb636547816 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.166025 Oct 12 00:24:11.317420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 293/575] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:11 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:11.329144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=6 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:11.419634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:11.421970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:11.422579 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:11.427299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1319f0b2-386a-4b18-971b-ccdde81510d3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1662 microversion: 2.1 time: 0.149647 Oct 12 00:24:11.427885 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 283/576] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:11 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:11.428523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.429009 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.429447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.430141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.430594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.431015 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.503414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:11.504187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:11.510358 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.511186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.511703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.512474 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.512985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.513467 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.563834 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:11.570829 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c7707112-8250-4251-9da2-f60d8c54f2ff tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.152779 Oct 12 00:24:11.571617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 294/577] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:11 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:11.574713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:11.582509 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f05b10d4-a5ca-4d9b-be46-bb214ccec180 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1292 microversion: 2.1 time: 0.083098 Oct 12 00:24:11.583077 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 284/578] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:11 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:11.677715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:11.678248 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:11.680117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:11.685678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.686164 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.686626 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.687327 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:11.687881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:11.688325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:11.819636 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:11.828203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:11.829627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:11.830766 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4085b737-bca0-45f8-8f99-f9cf285d20d9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.157027 Oct 12 00:24:11.831322 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 295/579] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:11 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:12.341975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:12.342581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:12.349072 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.349708 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.350148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.350832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.351279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.351771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.450508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:12.451119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:12.457221 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.457689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.458110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.458790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.459350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.459792 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.492528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:12.501026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-dd947fa3-dfef-47ef-83ed-7a33d4a27dad tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.163828 Oct 12 00:24:12.501610 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 285/580] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:12 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:12.586274 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:12.594795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ffa0528b-ee42-449e-97ee-aa258f9a2eef tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1662 microversion: 2.1 time: 0.148632 Oct 12 00:24:12.595352 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:12.595500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 296/581] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:12 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:12.595993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:12.602366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.602848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.603278 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.604973 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:12.605451 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:12.605636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.606076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.606509 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.620481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.620972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.621398 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.622130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.622573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.623623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.686512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:12.694235 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-25cdd430-905c-4925-a354-e6708ca79f64 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1292 microversion: 2.1 time: 0.093165 Oct 12 00:24:12.694800 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 297/582] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:12 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:12.748052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:12.756315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-753bc7ee-4260-4ce7-827c-e49d3ce36a76 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.164851 Oct 12 00:24:12.757098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 286/583] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:12 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:12.856755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:12.857362 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:12.863283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.863788 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.864215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:12.864906 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:12.865387 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:12.865769 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.282768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:13.291930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:13.293472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:13.294634 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9d6a3346-c647-48ec-9362-ccefccd9252c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.441974 Oct 12 00:24:13.295177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 298/584] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:12 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:13.525157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:13.526255 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:13.532649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:13.533120 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:13.533551 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.534231 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:13.534676 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:13.535092 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.623453 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:13.624209 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:13.630128 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:13.630606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:13.631034 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.631755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:13.632207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:13.632692 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.679018 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:13.687262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f7379577-53ca-4b87-b2ad-645b377949ca tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1751 microversion: 2.1 time: 0.165866 Oct 12 00:24:13.703689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 287/585] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:13 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:13.720500 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:13.721370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:13.743137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:13.743661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:13.744324 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.745204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:13.745836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:13.746322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.792780 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:13.800959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-04e5a9de-d820-4a86-80de-963c7afc3975 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1662 microversion: 2.1 time: 0.181199 Oct 12 00:24:13.801443 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 299/586] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:13 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:13.806174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:13.806809 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:13.812720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:13.813399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:13.813992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.815057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:13.815697 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:13.816277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:13.847248 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:13.856634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-29d520e4-614f-411a-9b3c-e73349a00546 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1300 microversion: 2.1 time: 0.141666 Oct 12 00:24:13.857216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 288/587] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:13 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1300 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:14.061562 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:14.072018 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a27412a0-c9a5-44da-9061-40c88d9047d7 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1735 microversion: 2.1 time: 0.269334 Oct 12 00:24:14.073145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 300/588] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:13 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1735 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:14.321662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:14.323211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:14.335957 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:14.336912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:14.337361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:14.338068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:14.338519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:14.338942 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:14.478243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:14.487583 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:14.489007 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:14.490148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7a597920-49a6-44d2-a67a-1ee0fb26f82a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.173280 Oct 12 00:24:14.490734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 289/589] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:14 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:14.711233 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:14.711972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:14.717915 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:14.718449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:14.719058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:14.719669 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:14.720125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:14.720538 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:14.773656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-7896b70b-e729-4101-960e-891f2be38d83 req-9db40547-4e87-4859-bf61-5a9d65e5bb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce674c-f9e8-476b-b1e2-fe18ba36050a", "name": "network-vif-plugged", "status": "completed", "tag": "2dccc06d-e6ad-4199-a897-4c5df8e17ccf"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:14.799764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-7896b70b-e729-4101-960e-891f2be38d83 req-9db40547-4e87-4859-bf61-5a9d65e5bb3c service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:14.800253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-7896b70b-e729-4101-960e-891f2be38d83 req-9db40547-4e87-4859-bf61-5a9d65e5bb3c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:14.800744 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-7896b70b-e729-4101-960e-891f2be38d83 req-9db40547-4e87-4859-bf61-5a9d65e5bb3c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:14.814672 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-7896b70b-e729-4101-960e-891f2be38d83 req-9db40547-4e87-4859-bf61-5a9d65e5bb3c service nova] Creating event network-vif-plugged:2dccc06d-e6ad-4199-a897-4c5df8e17ccf for instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a on hv-cinder-84914 Oct 12 00:24:14.820491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-7896b70b-e729-4101-960e-891f2be38d83 req-9db40547-4e87-4859-bf61-5a9d65e5bb3c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057680 Oct 12 00:24:14.821676 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 290/590] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:24:14.830039 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:14.830820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:14.839013 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:14.839660 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:14.840103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:14.840898 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:14.841557 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:14.842211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:14.996949 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:15.003679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:15.005176 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-957511e4-3341-4e8a-9d16-6df6ab4fc285 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1662 microversion: 2.1 time: 0.179892 Oct 12 00:24:15.005889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 291/591] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:14 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1662 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:15.010469 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:15.011322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:15.014151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-621486b4-4f1f-4868-9c7a-40c7c4fa3c5c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.306464 Oct 12 00:24:15.015669 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 301/592] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:14 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:15.017519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.017997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.018443 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.019120 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.019617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.020033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.087282 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:15.095687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:15.096303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:15.097284 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4084eec6-b274-48a7-a0ee-be66b66189fd tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1298 microversion: 2.1 time: 0.089970 Oct 12 00:24:15.097803 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 292/593] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:15 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:15.102872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.103359 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.104382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.105477 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.105602 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.105954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.303203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:15.312233 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5a8682b5-8627-4d0e-91a8-f2e8592a2496 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1715 microversion: 2.1 time: 0.220607 Oct 12 00:24:15.312746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 302/594] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:15 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1715 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:15.376371 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:15.376866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:15.382698 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.383179 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.383655 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.384347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.384796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.385756 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.476178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] HTTP exception thrown: Cannot 'detach_volume' instance 8894cbf9-861b-4b92-90ee-00bbe2777303 while it is in vm_state rescued Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Request method failure captured: Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments/cb44b640-ea6c-4bc8-b8b1-7ea33fb48f04 HTTP/1.1 Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg4D5QpA122m4lveLfp-9wK4wQY1TE92U5jGpsoHvTIDe3sVfW71KUvl95hjGK9nabV-xPoWv_cueB36pe1p0iuF5EEjQbKRkVvXU96pA9dHpMADtwbatpjx02JePAouRZp5PfqxNe6tBM68X2Kurf9NMVBV7WSgbG7GXeRsglkyD4 Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:24:15.478056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38c7ea1f3f9848b484a56cf74a2bd129", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: cdd87151f3af4a3bb1c3815db5d0e8fa Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:24:15.479646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Cannot 'detach_volume' instance 8894cbf9-861b-4b92-90ee-00bbe2777303 while it is in vm_state rescued Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'server_id': '8894cbf9-861b-4b92-90ee-00bbe2777303', 'id': 'cb44b640-ea6c-4bc8-b8b1-7ea33fb48f04'} Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8894cbf9-861b-4b92-90ee-00bbe2777303 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:24:15.480306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8894cbf9-861b-4b92-90ee-00bbe2777303 while it is in vm_state rescued Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8894cbf9-861b-4b92-90ee-00bbe2777303 while it is in vm_state rescued Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:24:15.482095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Returning 409 to user: Cannot 'detach_volume' instance 8894cbf9-861b-4b92-90ee-00bbe2777303 while it is in vm_state rescued {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:24:15.483320 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5b39afc2-f344-44a3-bda3-8d0f6dea2cf1 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments/cb44b640-ea6c-4bc8-b8b1-7ea33fb48f04" status: 409 len: 152 microversion: 2.1 time: 0.107149 Oct 12 00:24:15.483320 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 293/595] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:24:15 2022] DELETE /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments/cb44b640-ea6c-4bc8-b8b1-7ea33fb48f04 => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 00:24:15.488539 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:15.489166 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:15.497036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.497854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.498617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.499837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.500300 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.500790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.516790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:15.517395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:15.524153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.524691 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.525117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.526444 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.526842 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.527258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.720508 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:15.730456 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:15.732043 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:15.733272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d6b37337-9257-41cf-9630-3ac78486e443 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.220322 Oct 12 00:24:15.733835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 294/596] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:15 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:24:15.761657 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0fd7b194-bb9b-4351-934b-abd78489263a tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "POST /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/action" status: 202 len: 0 microversion: 2.1 time: 0.276438 Oct 12 00:24:15.762283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 303/597] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:24:15 2022] POST /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:24:15.774271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:15.774887 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:15.777415 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:15.782275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.782769 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.783290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.789807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:15.790577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:15.790893 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:15.932523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:15.940912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-46fe24ca-a6a4-4765-b9d2-1c1512471aae tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1723 microversion: 2.1 time: 0.170650 Oct 12 00:24:15.943290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 295/598] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:15 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:16.029294 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:16.030017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:16.036520 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.037004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.037558 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.038256 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.038709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.039131 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.039418 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:16.040037 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:16.043615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:16.046396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.048213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.048655 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.049389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.049843 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.050272 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.182364 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:16.193207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-738ecb0f-cdf3-49ab-a18f-98f8cee0f0b4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1666 microversion: 2.1 time: 0.167824 Oct 12 00:24:16.205162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 304/599] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:16 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1666 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:16.214892 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:16.215752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:16.222536 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.223066 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.223520 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.224411 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.224593 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:16.234801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.234801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.235483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0dadd63e-aa0f-454d-82ac-ded55da0273b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.198758 Oct 12 00:24:16.236451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 296/600] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:16 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:16.455411 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:16.463081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8b0a04bd-26d7-4b22-8c6f-a6987197661d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.252829 Oct 12 00:24:16.463866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 305/601] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:16 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:16.758357 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:16.758976 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:16.765991 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.766520 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.766949 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.767681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.768140 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.768567 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.905279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:16.914793 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:16.917585 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:16.918713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f40d1eea-8302-4921-9b13-42b0e3fa8f3f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.164437 Oct 12 00:24:16.925265 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 297/602] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:16 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:16.965244 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:16.965886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:16.972098 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.972469 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.972908 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:16.973626 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:16.974094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:16.974516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:17.108537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:17.116995 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-27c8e29c-5a52-4bb0-8548-032260e58645 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1723 microversion: 2.1 time: 0.156198 Oct 12 00:24:17.121467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 306/603] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:16 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:17.143260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-325eab83-ad51-441e-b657-813bffcfb411 req-dd5d5e39-02d3-4b9d-aefa-ca8f085c1afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e994443-5484-48d9-9a1b-e9662eb497e2", "tag": "d4634f29-c1d0-4738-98cb-502e6977b79b"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:17.152964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-325eab83-ad51-441e-b657-813bffcfb411 req-dd5d5e39-02d3-4b9d-aefa-ca8f085c1afc service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:17.153524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-325eab83-ad51-441e-b657-813bffcfb411 req-dd5d5e39-02d3-4b9d-aefa-ca8f085c1afc service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:17.154005 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-325eab83-ad51-441e-b657-813bffcfb411 req-dd5d5e39-02d3-4b9d-aefa-ca8f085c1afc service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:17.165170 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-325eab83-ad51-441e-b657-813bffcfb411 req-dd5d5e39-02d3-4b9d-aefa-ca8f085c1afc service nova] Creating event network-changed:d4634f29-c1d0-4738-98cb-502e6977b79b for instance 7e994443-5484-48d9-9a1b-e9662eb497e2 on hv-cinder-84914 Oct 12 00:24:17.169411 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-325eab83-ad51-441e-b657-813bffcfb411 req-dd5d5e39-02d3-4b9d-aefa-ca8f085c1afc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029742 Oct 12 00:24:17.170011 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 298/604] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:24:17.259058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:17.259700 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:17.266748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:17.267225 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:17.267771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:17.268449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:17.268895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:17.269339 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:17.413466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:17.421729 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fca56503-2af6-4fcf-aafa-c2944075a85a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.166887 Oct 12 00:24:17.422352 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 307/605] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:17 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:17.486193 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:17.486896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:17.493068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:17.493544 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:17.493977 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:17.495347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:17.495993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:17.496421 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:17.501623 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=100 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:17.694620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:17.702423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f50eda8e-8149-4a49-ae3c-7c20a95c66a3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.220273 Oct 12 00:24:17.702912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 299/606] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:17 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:17.946055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:17.946724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:17.953434 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:17.953919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:17.955516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:17.955516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:17.956359 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:17.956359 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:18.096902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:18.106143 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:18.110262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:18.110262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cd3d3fc3-f99a-4c09-8a69-d7ad9023d7ed tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.167804 Oct 12 00:24:18.110262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 308/607] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:17 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:18.141069 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:18.141709 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:18.148163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:18.148637 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:18.149070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:18.149753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:18.150202 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:18.151148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:18.283766 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:18.292037 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8a90df4c-f7a5-41f9-b163-003f2175728d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1723 microversion: 2.1 time: 0.154813 Oct 12 00:24:18.292594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 300/608] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:18 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:18.445971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:18.446589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:18.453231 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:18.453722 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:18.454293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:18.454902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:18.455358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:18.456090 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:18.694994 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:18.704004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0e44c60f-f074-4eb7-abab-6250ffef6063 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.261768 Oct 12 00:24:18.704576 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 309/609] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:18 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:18.724240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:18.724951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:18.731832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:18.732310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:18.732739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:18.733429 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:18.733879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:18.734300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:18.869635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:18.877244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e95be006-88a6-4f70-b892-69442ea448d0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.156892 Oct 12 00:24:18.877823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 301/610] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:18 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:19.134414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:19.135556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:19.142117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:19.142596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:19.143022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:19.143753 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:19.144230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:19.144648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:19.274523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:19.283859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:19.285306 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:19.286468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c0cd53b7-e9a3-4824-9c5a-679a76cce6e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.156211 Oct 12 00:24:19.287025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 310/611] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:19 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:19.314995 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:19.315634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:19.323551 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:19.324031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:19.324456 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:19.325132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:19.325577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:19.325993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:19.454205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:19.462292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-92b3caed-d3d2-45c1-8d27-d7fe03eeabb4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1723 microversion: 2.1 time: 0.151109 Oct 12 00:24:19.462869 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 302/612] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:19 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:19.727748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:19.728281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:19.734818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:19.735301 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:19.735771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:19.736458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:19.736945 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:19.737368 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:19.875795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:19.883934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f68f3243-502d-4945-87b6-cd4d5786715b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.160274 Oct 12 00:24:19.884498 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 311/613] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:19 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:19.900225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:19.900892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:19.906951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:19.907449 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:19.907907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:19.908601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:19.909081 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:19.909503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:20.034389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:20.042872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2346f9c4-eb8a-4430-b23b-50b2bc5987d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.146577 Oct 12 00:24:20.043600 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 303/614] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:19 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:20.312064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:20.312752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:20.318741 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:20.319212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:20.319679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:20.320360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:20.320837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:20.321255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:20.485746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:20.490377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:20.492662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:20.492931 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:20.493363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:20.494061 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:20.494525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:20.494952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:20.522511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:20.534594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:20.536141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:20.537660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c12b6a58-647c-43d6-ae6d-1dd5587e172a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1809 microversion: 2.20 time: 0.229633 Oct 12 00:24:20.538232 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 312/615] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:20 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:24:20.642066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:20.650327 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6e8d1622-22b6-4692-bd30-f1fce0070772 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1723 microversion: 2.1 time: 0.168738 Oct 12 00:24:20.650920 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 304/616] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:20 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:20.906693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:20.907288 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:20.913222 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:20.913704 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:20.914191 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:20.914869 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:20.915312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:20.915811 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.056024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:21.064469 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-122aa7eb-92f5-45ab-80a5-aa10e8dd86dd tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.161668 Oct 12 00:24:21.065027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 313/617] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:20 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:21.065941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:21.066562 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:21.072944 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:21.073418 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:21.073849 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.074529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:21.074975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:21.075437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.203019 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:21.210621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bd4bfa3f-3704-4197-bd07-9d229c491858 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.148517 Oct 12 00:24:21.211181 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 305/618] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:21 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:21.562902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:21.563537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:21.569583 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:21.570057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:21.570483 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.571186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:21.571653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:21.572070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.673412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:21.674149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:21.680225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:21.680896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:21.681401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.682723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:21.683205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:21.683701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.699852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:21.708590 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:21.710043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:21.711243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c96d345a-ea1d-4069-b07b-642c834af7e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1796 microversion: 2.20 time: 0.152215 Oct 12 00:24:21.711820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 314/619] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:24:21 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1796 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:24:21.816261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:21.824962 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0a6e33c7-1a2a-43c2-9c0c-c44950fb720b tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1729 microversion: 2.1 time: 0.155508 Oct 12 00:24:21.825528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 306/620] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:21 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:21.846910 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:21.847449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:21.853299 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:21.853771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:21.854197 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.854872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:21.855314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:21.855757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:21.935663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4380c093-9ff5-403b-a641-747100980abb tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092429 Oct 12 00:24:21.936242 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 315/621] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Oct 12 00:24:21 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:24:22.087625 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:22.088266 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:22.094665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:22.095146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:22.095626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:22.096412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:22.096869 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:22.097294 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:22.233558 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:22.234512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:22.240354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:22.243523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:22.244960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:22.245461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:22.246947 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:22.247684 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:22.248319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:22.364465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:22.373379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-14fa658d-b95a-4a6e-be33-bc0e67810e0b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.289680 Oct 12 00:24:22.373957 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 307/622] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:22 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:22.385981 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:22.394494 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-386bcdde-4bd1-4241-bb3a-3a661d023c6c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.164887 Oct 12 00:24:22.395051 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 316/623] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:22 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:22.949201 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-70339e83-17b5-430a-8d2e-fa9707e64111 req-503add17-1cbf-43a8-af7a-812169a697ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8894cbf9-861b-4b92-90ee-00bbe2777303", "tag": "9df6017e-afa4-4f72-91b3-79f5fe5d9b49"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:22.959312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-70339e83-17b5-430a-8d2e-fa9707e64111 req-503add17-1cbf-43a8-af7a-812169a697ec service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:22.960088 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-70339e83-17b5-430a-8d2e-fa9707e64111 req-503add17-1cbf-43a8-af7a-812169a697ec service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:22.960535 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-70339e83-17b5-430a-8d2e-fa9707e64111 req-503add17-1cbf-43a8-af7a-812169a697ec service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:22.974180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-70339e83-17b5-430a-8d2e-fa9707e64111 req-503add17-1cbf-43a8-af7a-812169a697ec service nova] Creating event network-changed:9df6017e-afa4-4f72-91b3-79f5fe5d9b49 for instance 8894cbf9-861b-4b92-90ee-00bbe2777303 on hv-cinder-84914 Oct 12 00:24:22.978624 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-70339e83-17b5-430a-8d2e-fa9707e64111 req-503add17-1cbf-43a8-af7a-812169a697ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033711 Oct 12 00:24:22.979233 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 308/624] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:24:23.398550 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:23.398550 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:23.405738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:23.406268 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:23.406850 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:23.412372 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:23.412372 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:23.412372 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:23.418139 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:23.418951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:23.426903 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:23.433804 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:23.438881 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:23.440377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:23.440849 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:23.441279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:23.615648 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:23.625909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-99d1f106-ad73-4f3c-9bab-e779cf301ac3 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.211941 Oct 12 00:24:23.626807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 309/625] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:23 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:23.689613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:23.698556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-27fa3f81-d991-4d20-87bb-fcececb7227b tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.304942 Oct 12 00:24:23.699128 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 317/626] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:23 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:24.648831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:24.649440 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:24.656396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:24.656871 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:24.657304 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:24.657990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:24.658438 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:24.658861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:24.723511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:24.724351 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:24.731600 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:24.732501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:24.733059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:24.733630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:24.734077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:24.734656 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:24.881492 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:24.889456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:24.890276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-984586e1-d467-4c49-954f-d9b5f41fc2d2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.245242 Oct 12 00:24:24.890862 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 310/627] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:24 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:24.897750 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-564bb857-a3a0-4f9d-b0c4-129df76566c7 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.178107 Oct 12 00:24:24.898471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 318/628] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:24 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:25.003968 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-f7eee927-d84f-4311-ac2b-385337110b65 req-92571928-dbb5-422d-95cf-77cafdce78bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8894cbf9-861b-4b92-90ee-00bbe2777303", "tag": "9df6017e-afa4-4f72-91b3-79f5fe5d9b49"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:25.014736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-f7eee927-d84f-4311-ac2b-385337110b65 req-92571928-dbb5-422d-95cf-77cafdce78bc service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:25.016032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-f7eee927-d84f-4311-ac2b-385337110b65 req-92571928-dbb5-422d-95cf-77cafdce78bc service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:25.016816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-f7eee927-d84f-4311-ac2b-385337110b65 req-92571928-dbb5-422d-95cf-77cafdce78bc service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:25.029848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-f7eee927-d84f-4311-ac2b-385337110b65 req-92571928-dbb5-422d-95cf-77cafdce78bc service nova] Creating event network-changed:9df6017e-afa4-4f72-91b3-79f5fe5d9b49 for instance 8894cbf9-861b-4b92-90ee-00bbe2777303 on hv-cinder-84914 Oct 12 00:24:25.035174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-f7eee927-d84f-4311-ac2b-385337110b65 req-92571928-dbb5-422d-95cf-77cafdce78bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034689 Oct 12 00:24:25.036301 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 311/629] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:24:25.913311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:25.913910 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:25.922136 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:25.922746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:25.923251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:25.924040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:25.924551 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:25.925032 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:25.928098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:25.929367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:25.936746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:25.937521 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:25.938206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:25.939153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:25.939817 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:25.940473 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:26.068664 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:26.076284 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-894217a9-b219-4362-b0a3-d1ac1dddc667 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.166764 Oct 12 00:24:26.076944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 319/630] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:25 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:26.158757 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:26.167644 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c3b5fdea-4478-41e5-92da-f0ce33d34226 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1756 microversion: 2.1 time: 0.246211 Oct 12 00:24:26.168295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 312/631] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:25 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:26.918353 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-4eab6b8a-89cd-420e-8946-becfed7899c0 req-b6d916fb-ebb5-4239-ae7d-a62584d3821d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e994443-5484-48d9-9a1b-e9662eb497e2", "name": "network-vif-plugged", "status": "completed", "tag": "d4634f29-c1d0-4738-98cb-502e6977b79b"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:26.928008 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4eab6b8a-89cd-420e-8946-becfed7899c0 req-b6d916fb-ebb5-4239-ae7d-a62584d3821d service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:26.928478 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4eab6b8a-89cd-420e-8946-becfed7899c0 req-b6d916fb-ebb5-4239-ae7d-a62584d3821d service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:26.928902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4eab6b8a-89cd-420e-8946-becfed7899c0 req-b6d916fb-ebb5-4239-ae7d-a62584d3821d service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:26.940313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-4eab6b8a-89cd-420e-8946-becfed7899c0 req-b6d916fb-ebb5-4239-ae7d-a62584d3821d service nova] Creating event network-vif-plugged:d4634f29-c1d0-4738-98cb-502e6977b79b for instance 7e994443-5484-48d9-9a1b-e9662eb497e2 on hv-cinder-84914 Oct 12 00:24:26.945102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-4eab6b8a-89cd-420e-8946-becfed7899c0 req-b6d916fb-ebb5-4239-ae7d-a62584d3821d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030523 Oct 12 00:24:26.948568 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 320/632] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:24:27.099017 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:27.099686 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:27.106084 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:27.106564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:27.106999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:27.107719 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:27.108171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:27.108590 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:27.191301 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:27.191830 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:27.197973 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:27.198452 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:27.198910 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:27.199622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:27.200071 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:27.200497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:27.243059 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:27.251952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e4a3a4cf-c5d4-44b0-9ec1-7f4690d0c379 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.156719 Oct 12 00:24:27.252529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 313/633] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:27 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:27.399595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:27.403061 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:27.408159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-667fe502-f630-438b-9835-30a4a318fa5a tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1759 microversion: 2.1 time: 0.221482 Oct 12 00:24:27.408726 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 321/634] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:27 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1759 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:24:28.274056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:28.274675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:28.281838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:28.282317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:28.282758 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:28.283482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:28.283939 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:28.284376 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:28.415961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:28.423596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-46cfd143-49d2-4cd0-a160-c1531abbfe1d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1365 microversion: 2.1 time: 0.153416 Oct 12 00:24:28.424307 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 314/635] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:28 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:29.446050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:29.446655 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:29.453534 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:29.454015 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:29.454461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:29.455136 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:29.455613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:29.456032 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:29.586584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:24:29.594970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6cefae0b-d1a0-4c16-9346-48e0022c6456 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1556 microversion: 2.1 time: 0.152761 Oct 12 00:24:29.595593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 322/636] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:29 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:24:29.616704 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:29.617232 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:29.623815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:29.624361 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:29.624807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:29.625503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:29.625955 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:29.626378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:29.702727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-37f7c4bb-0aca-422d-aceb-290ef2b33b81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089863 Oct 12 00:24:29.703324 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 315/637] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Oct 12 00:24:29 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:24:30.684993 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-43d8270d-b7e0-4df7-a9e2-a15a15f37295 req-5fa22d0b-932f-4cf4-9cea-3d700894c4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e994443-5484-48d9-9a1b-e9662eb497e2", "tag": "d4634f29-c1d0-4738-98cb-502e6977b79b"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:24:30.694433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-43d8270d-b7e0-4df7-a9e2-a15a15f37295 req-5fa22d0b-932f-4cf4-9cea-3d700894c4e6 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:30.694901 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-43d8270d-b7e0-4df7-a9e2-a15a15f37295 req-5fa22d0b-932f-4cf4-9cea-3d700894c4e6 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:30.695335 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-43d8270d-b7e0-4df7-a9e2-a15a15f37295 req-5fa22d0b-932f-4cf4-9cea-3d700894c4e6 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:30.706806 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-43d8270d-b7e0-4df7-a9e2-a15a15f37295 req-5fa22d0b-932f-4cf4-9cea-3d700894c4e6 service nova] Creating event network-changed:d4634f29-c1d0-4738-98cb-502e6977b79b for instance 7e994443-5484-48d9-9a1b-e9662eb497e2 on hv-cinder-84914 Oct 12 00:24:30.711739 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-43d8270d-b7e0-4df7-a9e2-a15a15f37295 req-5fa22d0b-932f-4cf4-9cea-3d700894c4e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030811 Oct 12 00:24:30.712656 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 323/638] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:24:59.251891 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=41 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:59.252645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=90 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:59.256611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:59.259047 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:59.265824 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:59.269259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:59.269259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:59.269259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:59.269259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:59.269659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:59.296925 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-735ef1f8-c8c7-48aa-9169-88e3a4e3efb2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046867 Oct 12 00:24:59.297483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 316/639] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:24:59 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:24:59.357261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=14 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:59.358002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=8 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:24:59.362860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:59.363499 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:59.369446 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:59.369922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:59.370354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:59.371042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:59.371520 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:59.371939 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:59.396865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:24:59.655563 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0b6de968-84d3-4498-8a71-88907348d69f tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 204 len: 0 microversion: 2.1 time: 0.299147 Oct 12 00:24:59.656149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 324/640] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:24:59 2022] DELETE /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:24:59.664188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:24:59.664798 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:24:59.671564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:59.672034 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:59.672468 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:24:59.673144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:24:59.673591 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:24:59.674006 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:00.000674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:00.008342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-28d0ec67-d22f-46e1-86c0-fd21e5c51e5a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1672 microversion: 2.1 time: 0.348013 Oct 12 00:25:00.008911 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 317/641] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:24:59 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1672 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:01.030518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:01.031077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:01.031317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:01.032026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:01.037422 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:01.037906 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:01.038363 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:01.038476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:01.038940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:01.039044 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:01.039410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:01.039554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:01.039971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:01.040118 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:01.040564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:01.041004 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:01.072916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-689ff65a-64e9-4e81-a163-d754ced4545b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments/a74eed5e-81cc-40e3-a3d6-a0ef44cff59c" status: 200 len: 194 microversion: 2.20 time: 0.046848 Oct 12 00:25:01.073684 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 325/642] 10.222.0.36 () {60 vars in 1454 bytes} [Wed Oct 12 00:25:01 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments/a74eed5e-81cc-40e3-a3d6-a0ef44cff59c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:25:01.146617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:01.147111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:01.153496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:01.153975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:01.154409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:01.155142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:01.155642 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:01.156065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:01.181895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:01.195978 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f9890b9d-5de9-4211-80db-f3f8de93912d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1672 microversion: 2.1 time: 0.168350 Oct 12 00:25:01.196689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 318/643] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:01 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:01.403051 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lazy-loading 'services' on Instance uuid 90ce674c-f9e8-476b-b1e2-fe18ba36050a {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:01.669468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-02a95dec-173e-4ecf-8f20-23930979c4f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments/a74eed5e-81cc-40e3-a3d6-a0ef44cff59c" status: 202 len: 0 microversion: 2.20 time: 0.526697 Oct 12 00:25:01.670111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 326/644] 10.222.0.36 () {60 vars in 1457 bytes} [Wed Oct 12 00:25:01 2022] DELETE /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments/a74eed5e-81cc-40e3-a3d6-a0ef44cff59c => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 00:25:01.678565 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:01.680840 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:01.686666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:01.687144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:01.687609 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:01.688298 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:01.688748 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:01.689170 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:01.718894 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-dc2ce1b6-2efb-4713-89c2-0686d2e277b7 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044248 Oct 12 00:25:01.719389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 319/645] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Oct 12 00:25:01 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:25:02.221192 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:02.222171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:02.228488 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:02.228964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:02.229393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:02.230082 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:02.230556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:02.230970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:02.372350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:02.380689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-99fcad2f-d5d5-45b5-a4b2-605b222b103e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1672 microversion: 2.1 time: 0.163810 Oct 12 00:25:02.381249 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 327/646] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:02 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:02.731498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:02.734396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:02.740808 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:02.741286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:02.741715 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:02.742404 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:02.742845 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:02.743292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:02.772389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b502d42e-0c4b-4351-93f3-65a93c307c8e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044819 Oct 12 00:25:02.773008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 320/647] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Oct 12 00:25:02 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:25:03.404460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:03.405664 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:03.411797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.412503 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.413048 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.413958 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.414408 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.414823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.510466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:03.527658 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-78d1264c-9d82-4ef8-ad89-66eb68e64cad tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1605 microversion: 2.1 time: 0.126899 Oct 12 00:25:03.535771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 328/648] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:03 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1605 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:03.579155 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-c7ff8365-82f6-417a-aabc-3d667d02e7a5 req-c29b5e75-39a8-4efd-a8d3-6a263e79ffe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a130e92-2fae-45a7-a64c-bffbf46b4758", "name": "network-vif-deleted", "tag": "2d8c0a54-e70d-4bc8-9356-dab7272389bd"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:03.588884 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-c7ff8365-82f6-417a-aabc-3d667d02e7a5 req-c29b5e75-39a8-4efd-a8d3-6a263e79ffe9 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.589357 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-c7ff8365-82f6-417a-aabc-3d667d02e7a5 req-c29b5e75-39a8-4efd-a8d3-6a263e79ffe9 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.589785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-c7ff8365-82f6-417a-aabc-3d667d02e7a5 req-c29b5e75-39a8-4efd-a8d3-6a263e79ffe9 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.602370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-c7ff8365-82f6-417a-aabc-3d667d02e7a5 req-c29b5e75-39a8-4efd-a8d3-6a263e79ffe9 service nova] Creating event network-vif-deleted:2d8c0a54-e70d-4bc8-9356-dab7272389bd for instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 on hv-cinder-84914 Oct 12 00:25:03.609870 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-c7ff8365-82f6-417a-aabc-3d667d02e7a5 req-c29b5e75-39a8-4efd-a8d3-6a263e79ffe9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033268 Oct 12 00:25:03.609870 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 321/649] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:03.785576 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:03.793444 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:03.794031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:03.806377 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:03.820289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.820518 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.820774 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.820893 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.821198 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.821318 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.821928 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.822429 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.822881 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.825083 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.832240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.833986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.870448 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1ce7a7c6-809c-4e88-9c2c-d5e12764558a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.088847 Oct 12 00:25:03.877128 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 329/650] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Oct 12 00:25:03 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:03.910956 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lazy-loading 'services' on Instance uuid 8894cbf9-861b-4b92-90ee-00bbe2777303 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:03.948865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:03.949747 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:03.956360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.956842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.957273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.957983 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:03.958597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:03.959201 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:03.994460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:25:04.161757 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5ea21d77-5a53-48ca-8d9c-f2e012623793 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments/cb44b640-ea6c-4bc8-b8b1-7ea33fb48f04" status: 202 len: 0 microversion: 2.1 time: 0.372863 Oct 12 00:25:04.162784 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 322/651] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:25:03 2022] DELETE /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments/cb44b640-ea6c-4bc8-b8b1-7ea33fb48f04 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:25:04.172772 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:04.176173 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:04.183576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:04.184293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:04.185049 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:04.185994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:04.187033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:04.187574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:04.220780 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e19e5198-a703-4985-8741-892e20fd256e tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053229 Oct 12 00:25:04.223515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 323/652] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:04 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:04.329904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dd147cde-0efd-4852-b358-880c700d3939 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 204 len: 0 microversion: 2.20 time: 0.384796 Oct 12 00:25:04.330497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 330/653] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Oct 12 00:25:03 2022] DELETE /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 00:25:04.338767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:04.339388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:04.346365 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:04.346855 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:04.347286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:04.348017 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:04.348464 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:04.348883 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:04.482837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:04.492172 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:04.493626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:04.494899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-43cad173-2e81-4b11-a340-fd5b61dd1440 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.159927 Oct 12 00:25:04.495427 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 324/654] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:04 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:04.551440 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:04.552149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:04.558276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:04.558757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:04.559217 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:04.559940 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:04.560388 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:04.560806 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:04.606220 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:04.606861 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:04.607114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:04.607584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'fault' on Instance uuid 1a130e92-2fae-45a7-a64c-bffbf46b4758 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:04.650525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:04.658927 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-281fb867-90fb-4a27-869d-42ee09dcd51d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1327 microversion: 2.1 time: 0.111869 Oct 12 00:25:04.664738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 331/655] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:04 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:05.233704 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:05.235913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:05.242405 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:05.242877 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:05.243306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:05.244016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:05.244467 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:05.244890 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:05.274985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-30d2743a-2fde-48c3-a56e-44dc8933b72c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045239 Oct 12 00:25:05.275570 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 325/656] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:05 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:05.521772 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:05.522375 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:05.528285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:05.528755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:05.529177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:05.529879 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:05.530296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:05.530743 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:05.661473 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:05.669610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:05.674679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:05.674679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-84ecd159-a49b-4522-a050-306e77e8fa27 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.154720 Oct 12 00:25:05.674679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 332/657] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:05 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:05.681522 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:05.682202 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:05.688852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:05.689409 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:05.689908 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:05.690596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:05.691077 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:05.691534 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:05.721498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:05.721969 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:05.722395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:05.722827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'fault' on Instance uuid 1a130e92-2fae-45a7-a64c-bffbf46b4758 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:05.765701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:05.773244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0dcbb343-e91d-4c46-92c5-f83e37b3c9d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1327 microversion: 2.1 time: 0.095475 Oct 12 00:25:05.773743 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 326/658] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:05 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:06.286925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:06.289108 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:06.295044 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:06.296067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:06.296492 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:06.297169 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:06.297615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:06.298032 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:06.327232 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a428416c-02c6-4231-aa7e-4aa12275e1ca tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Oct 12 00:25:06.327797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 333/659] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:06 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:06.699835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:06.700421 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:06.706706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:06.707190 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:06.707659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:06.708352 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:06.708802 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:06.709222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:06.796865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:06.798105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:06.804054 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:06.807036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:06.807036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:06.807036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:06.807036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:06.807564 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:06.838153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:06.838637 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:06.839024 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:06.839171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:06.839595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'fault' on Instance uuid 1a130e92-2fae-45a7-a64c-bffbf46b4758 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:06.848716 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:06.850301 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:06.851488 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-13a0c988-e13e-4b74-adaa-58d68fc26843 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1724 microversion: 2.20 time: 0.155609 Oct 12 00:25:06.852050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 327/660] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:06 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:06.880181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:06.888184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d08cf2a8-308d-4a99-9295-0a8107337048 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 200 len: 1327 microversion: 2.1 time: 0.095634 Oct 12 00:25:06.888749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 334/661] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:06 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:07.339209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:07.341686 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:07.347927 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:07.348536 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:07.348973 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:07.350056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:07.350357 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:07.350784 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:07.384355 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-25a22dd1-b355-4256-823d-5bf634248153 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048980 Oct 12 00:25:07.385612 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 328/662] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:07 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:07.877403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:07.877987 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:07.884135 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:07.884639 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:07.885072 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:07.885906 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:07.886357 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:07.886776 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:07.971141 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:07.975414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:07.987909 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:08.003564 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:08.003564 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-60a9269b-6aa6-42f3-9c58-1b28190347ac tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1656 microversion: 2.20 time: 0.121990 Oct 12 00:25:08.003564 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 335/663] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:07 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1656 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:08.041895 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:08.042532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:08.054529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:08.055067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:08.055542 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:08.056242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:08.056910 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:08.057331 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:08.071436 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] HTTP exception thrown: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Request method failure captured: Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 HTTP/1.1 Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg2NieFVW2F0W2EvZWOtw1rXn7bYU7eiHdp_meRfZmsxc6TssbeEINQukdIVPGHdfZx8U8DcTo9AkoN-ulZ3U1X8utRwongGTVX6eB-P3R01k0wffpgz9GUVL7JArSor7Ei9477K_XWtVEDnm8DR57ZSyA_raT1sJk-0DZy3TWJVsQ Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:25:08.074254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_54567f4ea839415a94397e13f93d71cc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: bca53aca7b134df1949deb10858f14d0 Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:25:08.075872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '1a130e92-2fae-45a7-a64c-bffbf46b4758'} Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:08.076647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:25:08.077935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:08.078983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Returning 404 to user: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:08.078983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c1e3ecd3-549b-4f87-ae63-49692ac14768 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 404 len: 111 microversion: 2.1 time: 0.167094 Oct 12 00:25:08.078983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 329/664] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:07 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 00:25:08.083890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2b22123e-bc66-4e43-ab9c-d36dd400d8d5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '.version_select at 0x7f2fe8e3aee0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:08.215901 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2b22123e-bc66-4e43-ab9c-d36dd400d8d5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082396615" status: 202 len: 0 microversion: 2.1 time: 0.135671 Oct 12 00:25:08.218147 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 336/665] 10.222.0.36 () {58 vars in 1221 bytes} [Wed Oct 12 00:25:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2082396615 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:25:08.251644 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-95c78095-d719-42a1-b4fe-d4e8b45409cf req-a882c80d-fe81-4b4b-bb38-c0c4164dcf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ce674c-f9e8-476b-b1e2-fe18ba36050a", "name": "network-vif-deleted", "tag": "2dccc06d-e6ad-4199-a897-4c5df8e17ccf"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:08.263484 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-95c78095-d719-42a1-b4fe-d4e8b45409cf req-a882c80d-fe81-4b4b-bb38-c0c4164dcf3a service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:08.264223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-95c78095-d719-42a1-b4fe-d4e8b45409cf req-a882c80d-fe81-4b4b-bb38-c0c4164dcf3a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:08.264848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-95c78095-d719-42a1-b4fe-d4e8b45409cf req-a882c80d-fe81-4b4b-bb38-c0c4164dcf3a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:08.277318 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-95c78095-d719-42a1-b4fe-d4e8b45409cf req-a882c80d-fe81-4b4b-bb38-c0c4164dcf3a service nova] Creating event network-vif-deleted:2dccc06d-e6ad-4199-a897-4c5df8e17ccf for instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a on hv-cinder-84914 Oct 12 00:25:08.283899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-95c78095-d719-42a1-b4fe-d4e8b45409cf req-a882c80d-fe81-4b4b-bb38-c0c4164dcf3a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037111 Oct 12 00:25:08.285084 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 330/666] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:08.562091 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:08.564517 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:08.571749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:08.572240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:08.572680 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:08.573390 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:08.573850 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:08.574277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:08.608317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7542ab4b-01e9-4b69-a739-df9d29a199d5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.214973 Oct 12 00:25:08.609287 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 337/667] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:08 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303/os-volume_attachments => generated 25 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:25:08.695136 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:08.695750 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:08.703247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:08.703776 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:08.704304 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:08.705009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:08.705679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:08.706110 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:08.734637 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:25:08.877947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:09.026367 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:09.028722 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:09.035768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:09.036351 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:09.036955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:09.037785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:09.038350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:09.038906 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:09.055424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-85612e65-6b90-448a-bd6c-61dcfea277e2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 204 len: 0 microversion: 2.1 time: 0.364968 Oct 12 00:25:09.056314 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 331/668] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:25:08 2022] DELETE /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:25:09.065930 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:09.067502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:09.075251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:09.076096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:09.076677 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:09.077910 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lazy-loading 'fault' on Instance uuid 90ce674c-f9e8-476b-b1e2-fe18ba36050a {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:09.085219 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:09.085890 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:09.086493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:09.087191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:09.088042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:09.088753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:09.120747 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:09.130482 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:09.131982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:09.133198 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1aba4a71-e9c6-48f2-9248-e98a65f84605 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1372 microversion: 2.20 time: 0.110911 Oct 12 00:25:09.133763 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 338/669] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:09 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:25:09.139487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9bda3216-b0bf-4645-bebd-8025922c177b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'create', calling method: .version_select at 0x7f2fe8e498b0>, body: {"keypair": {"name": "tempest-keypair-803206802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpqfOKDNoxcCgoD6izgKDHwDKa/hbzgdGknKtIO9gyNrKSSKVFPH6lJ6gCBclgGFYRfNJex7w6puJCEF0nA3aCnZq4Rjt4GR+uURU5YYJ5QJ4E7f8XWtVdvm+2S0e6EXA=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:09.159188 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-9bda3216-b0bf-4645-bebd-8025922c177b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Getting quotas for project 54567f4ea839415a94397e13f93d71cc. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:25:09.163199 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-9bda3216-b0bf-4645-bebd-8025922c177b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Getting quotas for user bca53aca7b134df1949deb10858f14d0 and project 54567f4ea839415a94397e13f93d71cc. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:25:09.247622 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:09.252486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9bda3216-b0bf-4645-bebd-8025922c177b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.113607 Oct 12 00:25:09.252486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 339/670] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:25:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:09.256830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0604315a-360c-4c50-8e41-e8838929f6e0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1689 microversion: 2.1 time: 0.196006 Oct 12 00:25:09.257899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 332/671] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:09 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:09.853234 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1141163874"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:09.853774 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:09.860332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:09.862315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:09.862315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:09.862315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:09.862573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:09.862943 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:09.995037 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.network.security_group_api [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Removing security group f0c83657-5631-4236-9279-5a0a82070e50 from port 286053d8-514a-44bb-93e8-8591874205f2 Oct 12 00:25:10.160153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:10.160882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:10.167525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:10.168079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:10.168519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:10.169212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:10.169662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:10.170087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:10.209021 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:10.209502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:10.209965 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:10.210412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lazy-loading 'fault' on Instance uuid 90ce674c-f9e8-476b-b1e2-fe18ba36050a {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:10.251322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:10.259379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:10.260975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:10.262118 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d1ceba24-7f97-4bc0-9079-ff148694601c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1372 microversion: 2.20 time: 0.105910 Oct 12 00:25:10.263284 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 333/672] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:10 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1372 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:25:10.281484 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:10.282229 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:10.289551 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:10.290089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:10.290519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:10.291402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:10.291836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:10.297683 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:10.374368 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5f24c898-2e5c-4b63-aac0-91a0c0acddce tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "POST /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/action" status: 202 len: 0 microversion: 2.1 time: 0.524590 Oct 12 00:25:10.378352 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 340/673] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:25:09 2022] POST /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:25:10.386020 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-a94deb9e-5da9-4127-841b-87acf0cfe1fa req-2d50dc5d-462d-47c8-a6c8-73431c05cfcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d008f88e-de37-4b22-b411-7a5de1fef288", "tag": "286053d8-514a-44bb-93e8-8591874205f2"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:10.397569 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a94deb9e-5da9-4127-841b-87acf0cfe1fa req-2d50dc5d-462d-47c8-a6c8-73431c05cfcb service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:10.398261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a94deb9e-5da9-4127-841b-87acf0cfe1fa req-2d50dc5d-462d-47c8-a6c8-73431c05cfcb service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:10.398765 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a94deb9e-5da9-4127-841b-87acf0cfe1fa req-2d50dc5d-462d-47c8-a6c8-73431c05cfcb service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:10.410561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-a94deb9e-5da9-4127-841b-87acf0cfe1fa req-2d50dc5d-462d-47c8-a6c8-73431c05cfcb service nova] Creating event network-changed:286053d8-514a-44bb-93e8-8591874205f2 for instance d008f88e-de37-4b22-b411-7a5de1fef288 on hv-cinder-84914 Oct 12 00:25:10.415904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-a94deb9e-5da9-4127-841b-87acf0cfe1fa req-2d50dc5d-462d-47c8-a6c8-73431c05cfcb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033477 Oct 12 00:25:10.416742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 341/674] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:25:10.758665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:10.766883 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3d39bb5f-725a-4059-95b6-3c8105eb9f88 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1689 microversion: 2.1 time: 0.490304 Oct 12 00:25:10.767551 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 334/675] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:10 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1689 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:11.289985 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:11.290782 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:11.298501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:11.299250 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:11.299789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:11.305631 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:11.305631 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:11.305631 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:11.338135 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:11.338135 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:11.338135 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:11.338135 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lazy-loading 'fault' on Instance uuid 90ce674c-f9e8-476b-b1e2-fe18ba36050a {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:11.386418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:11.395293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:11.405556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:11.405556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f853da63-044b-4abb-b9fa-18fcca493226 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1372 microversion: 2.20 time: 0.112976 Oct 12 00:25:11.405556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 342/676] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:11 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:11.791440 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:11.791440 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:11.796908 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:11.797389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:11.797821 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:11.798509 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:11.798956 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:11.799400 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:11.877614 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1528800926", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "499fb018-9e00-4ed3-b355-c8bccdf8c8f0"}], "security_groups": [{"name": "tempest-securitygroup--1979235390"}], "key_name": "tempest-keypair-803206802", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:11.941498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:11.949200 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f9b1390a-fe01-42c0-9347-f0b87a8e1be3 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1689 microversion: 2.1 time: 0.163532 Oct 12 00:25:11.949772 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 335/677] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:11 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:12.034119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] validate_networks() for [('499fb018-9e00-4ed3-b355-c8bccdf8c8f0', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:25:12.378532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:12.379161 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:12.385707 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.386266 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.386874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.387666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.388384 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.388816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.472604 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lazy-loading 'services' on Instance uuid d008f88e-de37-4b22-b411-7a5de1fef288 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:12.599318 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:25:12.599849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:25:12.600484 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:25:12.600950 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:25:12.601422 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:25:12.610904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.611414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.611842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.612557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.614843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.614843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.629608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Getting quotas for project 54567f4ea839415a94397e13f93d71cc. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:25:12.633599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Getting quotas for user bca53aca7b134df1949deb10858f14d0 and project 54567f4ea839415a94397e13f93d71cc. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:25:12.644866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:25:12.647134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:25:12.660985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-461c0dd2-47d2-4a69-9178-ca0d4f74bc78 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments/3fb8929c-c472-40e5-879e-8bf356c5f1df" status: 202 len: 0 microversion: 2.1 time: 0.286829 Oct 12 00:25:12.664899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 336/678] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:25:12 2022] DELETE /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments/3fb8929c-c472-40e5-879e-8bf356c5f1df => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 00:25:12.667551 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:12.677412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:12.677412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.677412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.677412 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.678026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.678026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.678026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.708448 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.708923 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.709353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.709796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lazy-loading 'fault' on Instance uuid 90ce674c-f9e8-476b-b1e2-fe18ba36050a {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:12.751192 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:12.759275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:12.761378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:12.761866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7b089586-f312-4acd-8f38-410cf45f84a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 200 len: 1372 microversion: 2.20 time: 0.098792 Oct 12 00:25:12.764595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 337/679] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:12 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:12.767815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-65812ae2-d5f5-4ebc-99e6-026e04ed92b1 req-cd5b1bb4-d7ad-4bc5-8aa5-a86f741d11b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d008f88e-de37-4b22-b411-7a5de1fef288", "tag": "286053d8-514a-44bb-93e8-8591874205f2"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:12.776072 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f454199b-ce01-4389-96bc-2cd6d07a71c1 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.903292 Oct 12 00:25:12.777218 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 343/680] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:25:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:25:12.787150 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-65812ae2-d5f5-4ebc-99e6-026e04ed92b1 req-cd5b1bb4-d7ad-4bc5-8aa5-a86f741d11b4 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.790135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-65812ae2-d5f5-4ebc-99e6-026e04ed92b1 req-cd5b1bb4-d7ad-4bc5-8aa5-a86f741d11b4 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.790135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-65812ae2-d5f5-4ebc-99e6-026e04ed92b1 req-cd5b1bb4-d7ad-4bc5-8aa5-a86f741d11b4 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.793047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:12.795541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:12.805358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.806081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.815652 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.815755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-65812ae2-d5f5-4ebc-99e6-026e04ed92b1 req-cd5b1bb4-d7ad-4bc5-8aa5-a86f741d11b4 service nova] Creating event network-changed:286053d8-514a-44bb-93e8-8591874205f2 for instance d008f88e-de37-4b22-b411-7a5de1fef288 on hv-cinder-84914 Oct 12 00:25:12.816178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.816178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.816178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.816394 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-65812ae2-d5f5-4ebc-99e6-026e04ed92b1 req-cd5b1bb4-d7ad-4bc5-8aa5-a86f741d11b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051136 Oct 12 00:25:12.818614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 338/681] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:12.836276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-acbe37a1-3c92-4cd3-81b0-c4596c87f53c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:12.837051 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-acbe37a1-3c92-4cd3-81b0-c4596c87f53c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:12.845484 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6a6eae28-26cb-4200-80b7-eaa860f4b366 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056952 Oct 12 00:25:12.850534 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 344/682] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:12 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:12.902292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-acbe37a1-3c92-4cd3-81b0-c4596c87f53c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:12.909822 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-acbe37a1-3c92-4cd3-81b0-c4596c87f53c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1237 microversion: 2.1 time: 0.088571 Oct 12 00:25:12.910583 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 339/683] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:12 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:12.973787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:12.974395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:12.981553 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.982863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.983525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:12.984281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:12.984749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:12.985224 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:13.122898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:13.130804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3a4f0af7-d5fb-447d-8d0c-57766d32ba44 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1689 microversion: 2.1 time: 0.161001 Oct 12 00:25:13.143756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 345/684] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:12 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:13.790596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:13.791186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:13.799044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:13.799561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:13.799999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:13.800701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:13.801158 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:13.801853 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:13.818912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] HTTP exception thrown: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Request method failure captured: Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a HTTP/1.1 Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgiIEbMiJg3ogRMpV1-1lkSVQOn1EhxHbHZHnEhLpuNw9tgauWu59f0I3Y3MBKh4CgHrUW78sqaxHF8BKard7kIZ6mnU6F23G7Ggb9mP8z165NyMlli4RL3WZslxFFxVQeHqI27DEp7dP_HhN3YAKYqZ1tm8RN8jT-p5HHkZF1j4mjk Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:25:13.820596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bdb0f5c58a40af9e420f6072f2f2b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: 63474c55edbf4b22ad609471a2414ede Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:25:13.822218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '90ce674c-f9e8-476b-b1e2-fe18ba36050a'} Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:13.823070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:25:13.824573 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:13.826473 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Returning 404 to user: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:13.827344 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-77597924-24c6-4c74-9699-cea080780310 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 404 len: 111 microversion: 2.20 time: 0.040911 Oct 12 00:25:13.827934 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 340/685] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:13 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:25:13.836778 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5189c760-f871-45fd-8743-4a4368e86f60 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '.version_select at 0x7f2fe8e17670>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:13.859916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:13.862185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:13.868413 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:13.869067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:13.869499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:13.870193 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:13.870643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:13.871062 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:13.903934 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-55e904a0-fcd1-497e-acc6-7197c1136978 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049223 Oct 12 00:25:13.905167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 341/686] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:13 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:13.925866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5189c760-f871-45fd-8743-4a4368e86f60 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229662495" status: 204 len: 0 microversion: 2.20 time: 0.092909 Oct 12 00:25:13.927031 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 346/687] 10.222.0.36 () {60 vars in 1262 bytes} [Wed Oct 12 00:25:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1229662495 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 00:25:13.940025 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:13.941214 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:13.947683 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:13.948208 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:13.948647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:13.949355 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:13.949836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:13.950240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:14.014163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:14.022634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-43eec549-c744-4197-9a92-60ae2621e908 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1241 microversion: 2.1 time: 0.092262 Oct 12 00:25:14.023225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 342/688] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:13 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:14.154089 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:14.154694 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:14.171394 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:14.171394 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:14.171394 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:14.171394 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:14.171742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:14.171742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:14.265067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:14.280634 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-32dfee8e-8206-4ea4-80fd-e5e1313023c5 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1621 microversion: 2.1 time: 0.129819 Oct 12 00:25:14.283424 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 347/689] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:14 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1621 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:14.839050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-5ce057ce-e8f3-4cad-aef1-36a5d0b8a564 req-a9ff4ecf-8258-41fb-9187-bdf90522ab0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8894cbf9-861b-4b92-90ee-00bbe2777303", "name": "network-vif-deleted", "tag": "9df6017e-afa4-4f72-91b3-79f5fe5d9b49"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:14.849878 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-5ce057ce-e8f3-4cad-aef1-36a5d0b8a564 req-a9ff4ecf-8258-41fb-9187-bdf90522ab0b service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:14.853032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-5ce057ce-e8f3-4cad-aef1-36a5d0b8a564 req-a9ff4ecf-8258-41fb-9187-bdf90522ab0b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:14.853032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-5ce057ce-e8f3-4cad-aef1-36a5d0b8a564 req-a9ff4ecf-8258-41fb-9187-bdf90522ab0b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:14.864863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-5ce057ce-e8f3-4cad-aef1-36a5d0b8a564 req-a9ff4ecf-8258-41fb-9187-bdf90522ab0b service nova] Creating event network-vif-deleted:9df6017e-afa4-4f72-91b3-79f5fe5d9b49 for instance 8894cbf9-861b-4b92-90ee-00bbe2777303 on hv-cinder-84914 Oct 12 00:25:14.870074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-5ce057ce-e8f3-4cad-aef1-36a5d0b8a564 req-a9ff4ecf-8258-41fb-9187-bdf90522ab0b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034599 Oct 12 00:25:14.872777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 343/690] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:14.917207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:14.919581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:14.923898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:14.927790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:14.928377 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:14.928883 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:14.929653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:14.930169 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:14.930679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:14.961653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-99980029-8239-415c-bf7d-2b8bab926064 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048526 Oct 12 00:25:14.962838 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 348/691] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:14 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:25:14.974321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:14.974910 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:14.981076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:14.981563 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:14.984997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:14.984997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:14.984997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:14.984997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:15.060695 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:15.060695 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:15.060695 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:15.060931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:15.061218 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:15.062083 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:15.063747 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:15.064497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:15.073417 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] HTTP exception thrown: Instance d008f88e-de37-4b22-b411-7a5de1fef288 is not attached to volume 3fb8929c-c472-40e5-879e-8bf356c5f1df Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Request method failure captured: Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments/3fb8929c-c472-40e5-879e-8bf356c5f1df HTTP/1.1 Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgisQ0w5xVEg7JU5l0mPaY1VMZVGYtJcpWFK6Gxo_Hk8KBi1mc20EJCOZBirTFwoF3HgV2HSnpBh9xsVxjIAOITpqDQmH-rtXXNkAIuiOemmDo80J9_qSed34TrCa7MVkYkThGl0-Lec2EIu1UbFeg13poUAHHQAYxD7_hVip30EJn8 Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 33e38693dbe5490fb39cd1981274a5f6 Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-TestMinimumBasicScenario-2079007867 Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:25:15.076561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33e38693dbe5490fb39cd1981274a5f6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33e38693dbe5490fb39cd1981274a5f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33e38693dbe5490fb39cd1981274a5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33e38693dbe5490fb39cd1981274a5f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-TestMinimumBasicScenario-2079007867 Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 33e38693dbe5490fb39cd1981274a5f6 Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2079007867 Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-TestMinimumBasicScenario-2079007867-project Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: 1c38342973094c43b412fff9e0f460d6 Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-TestMinimumBasicScenario-2079007867-project Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:25:15.078326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance d008f88e-de37-4b22-b411-7a5de1fef288 is not attached to volume 3fb8929c-c472-40e5-879e-8bf356c5f1df Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'server_id': 'd008f88e-de37-4b22-b411-7a5de1fef288', 'id': '3fb8929c-c472-40e5-879e-8bf356c5f1df'} Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3fb8929c-c472-40e5-879e-8bf356c5f1df. Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:15.079030 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d008f88e-de37-4b22-b411-7a5de1fef288 is not attached to volume 3fb8929c-c472-40e5-879e-8bf356c5f1df Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d008f88e-de37-4b22-b411-7a5de1fef288 is not attached to volume 3fb8929c-c472-40e5-879e-8bf356c5f1df Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:15.080147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Returning 404 to user: Instance d008f88e-de37-4b22-b411-7a5de1fef288 is not attached to volume 3fb8929c-c472-40e5-879e-8bf356c5f1df {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:15.081036 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-05cf3863-3511-41e8-a075-81eff16bcee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments/3fb8929c-c472-40e5-879e-8bf356c5f1df" status: 404 len: 154 microversion: 2.1 time: 0.108627 Oct 12 00:25:15.081036 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 344/692] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:25:14 2022] DELETE /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288/os-volume_attachments/3fb8929c-c472-40e5-879e-8bf356c5f1df => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:25:15.311762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:15.312383 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:15.324450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:15.325000 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:15.325436 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:15.326387 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:15.328026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:15.328789 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:15.372801 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:15.374237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:15.374918 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:15.375734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lazy-loading 'fault' on Instance uuid 8894cbf9-861b-4b92-90ee-00bbe2777303 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:15.408603 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:15.431744 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4a1de342-1c48-4a78-bbd6-aeee35ffb277 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1289 microversion: 2.1 time: 0.381766 Oct 12 00:25:15.431744 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 349/693] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:15 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1289 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:15.462777 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0ab22fe3-cd36-4f95-8c7d-20c5abed1e67 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'create', calling method: .version_select at 0x7f2fe8e17670>, body: {"keypair": {"name": "tempest-keypair-299954300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNkAXF+Svq0RTlob9rjBe0gGwEMUDJDK+GnTXr88t8h/uwmIcwdrUPK2HZU02XGDLiOoXhQrYUwnTlj5otFEMI1Zvj/5B4jI8ZMQJIujbZvxtsHnY5uG6mUe4BGLSeovA=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:15.472706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:15.479968 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-0ab22fe3-cd36-4f95-8c7d-20c5abed1e67 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Getting quotas for project 13bdb0f5c58a40af9e420f6072f2f2b0. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:25:15.484771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d9192565-9ec2-4f7f-9377-8eaee5b377a2 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 200 len: 1334 microversion: 2.1 time: 0.174453 Oct 12 00:25:15.484931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-0ab22fe3-cd36-4f95-8c7d-20c5abed1e67 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Getting quotas for user 63474c55edbf4b22ad609471a2414ede and project 13bdb0f5c58a40af9e420f6072f2f2b0. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:25:15.499515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 345/694] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:15 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 1334 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:15.565389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0ab22fe3-cd36-4f95-8c7d-20c5abed1e67 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.107083 Oct 12 00:25:15.566183 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 350/695] 10.222.0.36 () {62 vars in 1200 bytes} [Wed Oct 12 00:25:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 109 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 00:25:16.446535 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:16.447058 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:16.448833 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:16.452802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:16.455683 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:16.456219 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:16.456653 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:16.457590 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:16.458207 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:16.458636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:16.476403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:16.476994 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:16.477497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:16.478283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:16.479098 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:16.479620 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:16.486399 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:25:16.572891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:16.582120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-02cd3cf7-0113-4b6c-871d-b1a8acc7b8e3 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1295 microversion: 2.1 time: 0.137814 Oct 12 00:25:16.582690 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 351/696] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:16 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1295 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:16.588377 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:16.589195 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 8894cbf9-861b-4b92-90ee-00bbe2777303] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:16.596622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:16.597318 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:16.597920 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:16.599039 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:16.599606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:16.600247 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:16.616573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] HTTP exception thrown: Instance 8894cbf9-861b-4b92-90ee-00bbe2777303 could not be found. Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Request method failure captured: Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 HTTP/1.1 Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg4D5QpA122m4lveLfp-9wK4wQY1TE92U5jGpsoHvTIDe3sVfW71KUvl95hjGK9nabV-xPoWv_cueB36pe1p0iuF5EEjQbKRkVvXU96pA9dHpMADtwbatpjx02JePAouRZp5PfqxNe6tBM68X2Kurf9NMVBV7WSgbG7GXeRsglkyD4 Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:25:16.618959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38c7ea1f3f9848b484a56cf74a2bd129", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: cdd87151f3af4a3bb1c3815db5d0e8fa Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 8894cbf9-861b-4b92-90ee-00bbe2777303 could not be found. Oct 12 00:25:16.620291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '8894cbf9-861b-4b92-90ee-00bbe2777303'} Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8894cbf9-861b-4b92-90ee-00bbe2777303 could not be found. Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:16.620999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8894cbf9-861b-4b92-90ee-00bbe2777303 could not be found. Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8894cbf9-861b-4b92-90ee-00bbe2777303 could not be found. Oct 12 00:25:16.622158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:16.625537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Returning 404 to user: Instance 8894cbf9-861b-4b92-90ee-00bbe2777303 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:16.626675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-069227d4-c7a0-413b-958f-dd12d8e938f6 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303" status: 404 len: 111 microversion: 2.1 time: 0.042811 Oct 12 00:25:16.627577 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 352/697] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:16 2022] GET /compute/v2.1/servers/8894cbf9-861b-4b92-90ee-00bbe2777303 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:25:16.637420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1fb9e8b8-a173-4c04-be59-f13e5fe4601c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '.version_select at 0x7f2fe8e17280>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:16.708809 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1fb9e8b8-a173-4c04-be59-f13e5fe4601c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491537022" status: 202 len: 0 microversion: 2.1 time: 0.076276 Oct 12 00:25:16.709558 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 353/698] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Oct 12 00:25:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491537022 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 00:25:16.839992 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c0901c94-80b5-4b2e-b4db-2b5e192ef68c tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 204 len: 0 microversion: 2.1 time: 0.396003 Oct 12 00:25:16.841179 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 346/699] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:25:16 2022] DELETE /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:25:16.849557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:16.850171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:16.856787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:16.857302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:16.858426 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:16.859320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:16.859797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:16.860225 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:17.020390 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:17.028890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a2336445-820d-4f1f-9936-a761bd746231 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1554 microversion: 2.1 time: 0.183089 Oct 12 00:25:17.029479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 354/700] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:16 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:17.186244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:17.186959 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:17.194347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:17.199991 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:17.199991 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:17.199991 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:17.199991 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:17.200554 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:17.223441 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3fd2ac46-b3a6-4688-b3cc-3b00a7c8b891 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/ips" status: 200 len: 150 microversion: 2.1 time: 0.165472 Oct 12 00:25:17.224051 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 347/701] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:25:17 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/ips => generated 150 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:17.606349 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:17.607156 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:17.614893 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:17.615396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:17.615948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:17.616643 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:17.617093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:17.617512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:17.753890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:17.762114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ccb760e9-7b29-44e3-8fcc-aebec944ca4c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.159971 Oct 12 00:25:17.776816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 355/702] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:17 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:18.055186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:18.055994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:18.063926 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:18.064933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:18.065381 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:18.066733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:18.067189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:18.067779 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:18.088103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:18.273717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:18.281226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6ca90e5a-d5e8-46ea-9f3b-983017af0641 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1554 microversion: 2.1 time: 0.229968 Oct 12 00:25:18.281813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 348/703] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:18 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:18.792372 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:18.792944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:18.799916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:18.800402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:18.800832 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:18.801523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:18.801999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:18.802415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:18.897587 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a30cdb53-46bb-4e5c-87db-66996c795c0a"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:18.902001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:18.910768 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:18.911855 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:18.912109 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:18.912892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:18.913424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:18.914279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:19.024896 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:19.033161 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-861d252a-241b-439c-adef-28f3be8f37f0 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.244694 Oct 12 00:25:19.033822 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 356/704] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:18 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:19.039502 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1914280641", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c299ee8-2b42-4994-965e-051a94d2391c"}], "security_groups": [{"name": "tempest-securitygroup--1206365714"}], "key_name": "tempest-keypair-299954300", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:19.207323 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] validate_networks() for [('0c299ee8-2b42-4994-965e-051a94d2391c', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:25:19.686982 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e8da4753-9d80-43d4-947f-d3014e1fd25d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.793414 Oct 12 00:25:19.687614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 349/705] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:25:18 2022] POST /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:25:19.697472 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:19.700528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:19.710628 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:19.715269 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:19.715269 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:19.715269 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:19.715269 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:19.715626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:19.845020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:19.857679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3429e7ef-a75a-436e-aaf2-5893a2cf7ee3 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1512 microversion: 2.1 time: 0.166756 Oct 12 00:25:19.859173 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 350/706] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:19 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:19.878692 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-95dfa727-0984-496c-b048-5593a2663ce7 req-c92e3928-94fe-4561-84f4-a4af5c34b0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2e624a-ad19-4369-aebf-7af749828d71", "tag": "68692578-9ba0-4b5a-af9e-cb3c327ca4e7"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:19.879645 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:25:19.880109 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:25:19.880532 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:25:19.880939 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:25:19.881461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:25:19.892040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:19.892534 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:19.893298 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-95dfa727-0984-496c-b048-5593a2663ce7 req-c92e3928-94fe-4561-84f4-a4af5c34b0b4 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:19.893426 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:19.894046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:19.894258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-95dfa727-0984-496c-b048-5593a2663ce7 req-c92e3928-94fe-4561-84f4-a4af5c34b0b4 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:19.894506 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:19.894932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:19.895271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-95dfa727-0984-496c-b048-5593a2663ce7 req-c92e3928-94fe-4561-84f4-a4af5c34b0b4 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:19.911242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-95dfa727-0984-496c-b048-5593a2663ce7 req-c92e3928-94fe-4561-84f4-a4af5c34b0b4 service nova] Creating event network-changed:68692578-9ba0-4b5a-af9e-cb3c327ca4e7 for instance ca2e624a-ad19-4369-aebf-7af749828d71 on hv-cinder-84914 Oct 12 00:25:19.914658 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Getting quotas for project 13bdb0f5c58a40af9e420f6072f2f2b0. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:25:19.916468 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-95dfa727-0984-496c-b048-5593a2663ce7 req-c92e3928-94fe-4561-84f4-a4af5c34b0b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056561 Oct 12 00:25:19.917595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 351/707] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:19.918693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Getting quotas for user 63474c55edbf4b22ad609471a2414ede and project 13bdb0f5c58a40af9e420f6072f2f2b0. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:25:19.924370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-77b13f1a-c486-4041-8a4d-496c45e511d3 req-f2bed0ba-eb34-4baa-8740-4c159b98c73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d008f88e-de37-4b22-b411-7a5de1fef288", "name": "network-vif-deleted", "tag": "286053d8-514a-44bb-93e8-8591874205f2"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:19.931404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:25:19.933821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:25:19.934422 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-77b13f1a-c486-4041-8a4d-496c45e511d3 req-f2bed0ba-eb34-4baa-8740-4c159b98c73e service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:19.934993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-77b13f1a-c486-4041-8a4d-496c45e511d3 req-f2bed0ba-eb34-4baa-8740-4c159b98c73e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:19.935517 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-77b13f1a-c486-4041-8a4d-496c45e511d3 req-f2bed0ba-eb34-4baa-8740-4c159b98c73e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:19.947816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-77b13f1a-c486-4041-8a4d-496c45e511d3 req-f2bed0ba-eb34-4baa-8740-4c159b98c73e service nova] Creating event network-vif-deleted:286053d8-514a-44bb-93e8-8591874205f2 for instance d008f88e-de37-4b22-b411-7a5de1fef288 on hv-cinder-84914 Oct 12 00:25:19.952752 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-77b13f1a-c486-4041-8a4d-496c45e511d3 req-f2bed0ba-eb34-4baa-8740-4c159b98c73e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033729 Oct 12 00:25:19.953336 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 352/708] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:20.058166 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:20.060696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:20.065229 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:20.065782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:20.066222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:20.067066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:20.067558 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:20.067986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:20.105410 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-186b90b4-84d3-4a8e-8a5b-f73bfcd6c291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.070236 Oct 12 00:25:20.107145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 357/709] 10.222.0.36 () {62 vars in 1188 bytes} [Wed Oct 12 00:25:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 00:25:20.119790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b98873b9-154a-4f07-b230-065f45f5d0ea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:20.120820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b98873b9-154a-4f07-b230-065f45f5d0ea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:20.190525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b98873b9-154a-4f07-b230-065f45f5d0ea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:20.200239 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b98873b9-154a-4f07-b230-065f45f5d0ea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:20.204693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b98873b9-154a-4f07-b230-065f45f5d0ea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:20.204693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b98873b9-154a-4f07-b230-065f45f5d0ea tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1281 microversion: 2.20 time: 0.088008 Oct 12 00:25:20.204693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 358/710] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:20 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1281 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:25:20.317995 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:20.326239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0f2dd8ef-e359-43df-b2cc-e16c085c6743 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.272410 Oct 12 00:25:20.337292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 353/711] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:20 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:20.750415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:20.750913 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:20.756991 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:20.757471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:20.757907 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:20.760854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:20.760854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:20.760854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:20.785878 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:25:20.823466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:20.886064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:20.886604 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:20.890598 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:20.894037 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:20.894516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:20.894947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:20.895669 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:20.896116 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:20.896536 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:20.926689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:20.927166 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:20.934352 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:20.934897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lazy-loading 'fault' on Instance uuid d008f88e-de37-4b22-b411-7a5de1fef288 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:20.980380 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:20.988741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-545712ed-ab73-4d7a-b58d-ad71e6f857ff tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1348 microversion: 2.1 time: 0.106564 Oct 12 00:25:20.991592 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 354/712] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:20 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1348 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:21.076682 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8b129ec9-c891-458f-9ed7-51d108e6646c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "DELETE /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 204 len: 0 microversion: 2.1 time: 0.330295 Oct 12 00:25:21.078768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 359/713] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:25:20 2022] DELETE /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:25:21.085972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:21.086607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:21.092562 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:21.093079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:21.093508 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:21.094223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:21.094674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:21.095090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:21.221543 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:21.229348 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-69e15fee-7cd8-4c64-99d0-9a63cfc9727d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1507 microversion: 2.1 time: 0.147534 Oct 12 00:25:21.229909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 355/714] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:21 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:21.230641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:21.231344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:21.237804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:21.238317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:21.238758 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:21.239531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:21.240199 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:21.240633 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:21.302189 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:21.310104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:21.312099 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:21.313212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3f8cc60b-68ec-404a-bac3-b9ab62786140 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1285 microversion: 2.20 time: 0.086992 Oct 12 00:25:21.313764 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 360/715] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:21 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:25:21.348832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:21.349447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:21.355451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:21.355931 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:21.356365 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:21.357053 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:21.357564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:21.358493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:21.526444 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:21.535786 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4783bf6b-67ee-4574-8b1c-4bc5b1c8a2bc tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.190717 Oct 12 00:25:21.536477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 356/716] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:21 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:22.012067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:22.012705 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:22.019391 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.019881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.020315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.020999 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.021449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.021870 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.051461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.051929 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.052355 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.052790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lazy-loading 'fault' on Instance uuid d008f88e-de37-4b22-b411-7a5de1fef288 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:22.091634 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:22.099776 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f6d63b42-8355-46e5-9d18-f683c53e4fd9 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1348 microversion: 2.1 time: 0.091432 Oct 12 00:25:22.100340 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 361/717] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:22 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:22.253404 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:22.254015 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:22.260396 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.260872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.261302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.261989 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.262438 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.262858 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.337659 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:22.338283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:22.344310 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.344789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.345210 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.345891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.346336 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.346749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.392664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:22.400325 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b317aa3b-ceff-403b-99ae-873a45c8c84c tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1507 microversion: 2.1 time: 0.151540 Oct 12 00:25:22.400892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 357/718] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:22 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:22.410934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:22.418931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:22.420398 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:22.421479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b290c9ff-6e37-4ef6-9817-06f97340253e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1285 microversion: 2.20 time: 0.087718 Oct 12 00:25:22.422029 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 362/719] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:22 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:25:22.557938 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:22.558542 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:22.564972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.565448 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.565889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.566578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:22.567020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:22.567455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:22.691068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:22.698636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-fdfbfb11-7003-49dd-a3bd-56484e9ba31a tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.144549 Oct 12 00:25:22.699196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 358/720] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:22 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:23.122412 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:23.123019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:23.129191 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.129667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.130096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.130785 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.131231 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.131680 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.161914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.162393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.162820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.163266 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lazy-loading 'fault' on Instance uuid d008f88e-de37-4b22-b411-7a5de1fef288 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:23.203456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:23.211064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-04f50cc3-bee1-4bf0-bd50-2254627596d5 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1348 microversion: 2.1 time: 0.092429 Oct 12 00:25:23.211658 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 363/721] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:23 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:23.423064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:23.423697 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:23.425739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:23.430945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.431439 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.431884 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.432583 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.433027 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.433639 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.445825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:23.446619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:23.453024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.453498 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.453922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.454610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.455055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.455493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.516886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:23.524903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:23.526358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:23.527497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0f3b603b-fd61-4527-bfbf-31617c973687 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1285 microversion: 2.20 time: 0.085378 Oct 12 00:25:23.530934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 364/722] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:23 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:23.581812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:23.589362 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0fc36b8b-7b54-47f2-9d67-f71689e41ae4 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1507 microversion: 2.1 time: 0.170369 Oct 12 00:25:23.589922 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 359/723] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:23 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:23.721355 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:23.725964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:23.727991 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.728470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.728904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.729595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:23.730048 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:23.730472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:23.871855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:23.881088 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-86b36cb5-cfe1-4055-b4d8-4fb41ebf93ea tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.164102 Oct 12 00:25:23.882311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 365/724] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:23 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:24.234622 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:24.235153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:24.241134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.241615 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.242050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:24.242733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.243180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.243655 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:24.273377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.273847 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.274277 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:24.275171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lazy-loading 'fault' on Instance uuid d008f88e-de37-4b22-b411-7a5de1fef288 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:24.344627 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c38342973094c43b412fff9e0f460d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e38693dbe5490fb39cd1981274a5f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:24.352275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7920bad9-172b-4dc4-9556-85f7c1d01a07 tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 200 len: 1348 microversion: 2.1 time: 0.122203 Oct 12 00:25:24.352834 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 360/725] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:24 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 1348 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:24.553241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:24.553849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:24.560501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.561510 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.561946 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:24.562714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.563175 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.563621 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:24.613617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:24.614358 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:24.622547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.622851 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.623303 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:24.624074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.624641 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.625103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:24.669069 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:24.678830 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:24.680611 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:24.682077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-42ec1ec9-332b-4488-bf72-15f21add5b28 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1277 microversion: 2.20 time: 0.133176 Oct 12 00:25:24.699819 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 366/726] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:24 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:24.825071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:24.834824 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a6b9da63-841e-4918-bb18-65e1e8ba767f tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1507 microversion: 2.1 time: 0.226825 Oct 12 00:25:24.835607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 361/727] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:24 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:24.905894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:24.912823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:24.912823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.913014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.913433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:24.914111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:24.914554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:24.914971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.119228 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-ddecae10-12de-4a32-8c2a-ac5cfa29fa0c req-41f9a6fb-e815-4067-8d61-4b1dc8d386f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20228600-f497-4d8c-86c7-1ba7f1a986e0", "name": "network-vif-deleted", "tag": "5ebb0516-e416-4555-8242-08922710f750"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:25.123967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:25.128879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-ddecae10-12de-4a32-8c2a-ac5cfa29fa0c req-41f9a6fb-e815-4067-8d61-4b1dc8d386f1 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.129369 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-ddecae10-12de-4a32-8c2a-ac5cfa29fa0c req-41f9a6fb-e815-4067-8d61-4b1dc8d386f1 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.129789 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-ddecae10-12de-4a32-8c2a-ac5cfa29fa0c req-41f9a6fb-e815-4067-8d61-4b1dc8d386f1 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.132398 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bb2b8472-0fda-471a-a191-6d4523154aee tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.231449 Oct 12 00:25:25.144891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 367/728] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:24 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:25.145237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-ddecae10-12de-4a32-8c2a-ac5cfa29fa0c req-41f9a6fb-e815-4067-8d61-4b1dc8d386f1 service nova] Creating event network-vif-deleted:5ebb0516-e416-4555-8242-08922710f750 for instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 on hv-cinder-84914 Oct 12 00:25:25.150564 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-ddecae10-12de-4a32-8c2a-ac5cfa29fa0c req-41f9a6fb-e815-4067-8d61-4b1dc8d386f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034962 Oct 12 00:25:25.151211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 362/729] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:25:25.376134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:25.376734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] [instance: d008f88e-de37-4b22-b411-7a5de1fef288] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:25.385911 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.386382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.386813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.387540 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.387989 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.388664 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.399832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-0e88e3c2-3582-436a-9bab-935519495dbb req-c334a189-11dc-4417-be3d-8926339c0e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2e624a-ad19-4369-aebf-7af749828d71", "name": "network-vif-plugged", "status": "completed", "tag": "68692578-9ba0-4b5a-af9e-cb3c327ca4e7"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:25.417002 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-0e88e3c2-3582-436a-9bab-935519495dbb req-c334a189-11dc-4417-be3d-8926339c0e3d service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.420738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] HTTP exception thrown: Instance d008f88e-de37-4b22-b411-7a5de1fef288 could not be found. Oct 12 00:25:25.421262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-0e88e3c2-3582-436a-9bab-935519495dbb req-c334a189-11dc-4417-be3d-8926339c0e3d service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.421781 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-0e88e3c2-3582-436a-9bab-935519495dbb req-c334a189-11dc-4417-be3d-8926339c0e3d service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Request method failure captured: Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 HTTP/1.1 Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgisQ0w5xVEg7JU5l0mPaY1VMZVGYtJcpWFK6Gxo_Hk8KBi1mc20EJCOZBirTFwoF3HgV2HSnpBh9xsVxjIAOITpqDQmH-rtXXNkAIuiOemmDo80J9_qSed34TrCa7MVkYkThGl0-Lec2EIu1UbFeg13poUAHHQAYxD7_hVip30EJn8 Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 33e38693dbe5490fb39cd1981274a5f6 Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-TestMinimumBasicScenario-2079007867 Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:25:25.427281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_33e38693dbe5490fb39cd1981274a5f6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33e38693dbe5490fb39cd1981274a5f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/33e38693dbe5490fb39cd1981274a5f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/33e38693dbe5490fb39cd1981274a5f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-TestMinimumBasicScenario-2079007867 Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 33e38693dbe5490fb39cd1981274a5f6 Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2079007867 Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-TestMinimumBasicScenario-2079007867-project Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: 1c38342973094c43b412fff9e0f460d6 Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-TestMinimumBasicScenario-2079007867-project Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance d008f88e-de37-4b22-b411-7a5de1fef288 could not be found. Oct 12 00:25:25.431522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'd008f88e-de37-4b22-b411-7a5de1fef288'} Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d008f88e-de37-4b22-b411-7a5de1fef288 could not be found. Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:25.432251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d008f88e-de37-4b22-b411-7a5de1fef288 could not be found. Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d008f88e-de37-4b22-b411-7a5de1fef288 could not be found. Oct 12 00:25:25.433432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:25.434816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Returning 404 to user: Instance d008f88e-de37-4b22-b411-7a5de1fef288 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:25.434816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-94b138bd-046e-4614-80bd-d747c0f03ffe tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288" status: 404 len: 111 microversion: 2.1 time: 0.057190 Oct 12 00:25:25.434816 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 368/730] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:25 2022] GET /compute/v2.1/servers/d008f88e-de37-4b22-b411-7a5de1fef288 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:25:25.436938 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-0e88e3c2-3582-436a-9bab-935519495dbb req-c334a189-11dc-4417-be3d-8926339c0e3d service nova] Creating event network-vif-plugged:68692578-9ba0-4b5a-af9e-cb3c327ca4e7 for instance ca2e624a-ad19-4369-aebf-7af749828d71 on hv-cinder-84914 Oct 12 00:25:25.444850 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-90ea76dd-724c-4221-9bc8-8f6e8d3ebe2d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] Calling method '.version_select at 0x7f2fe8cca5e0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:25.448106 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-0e88e3c2-3582-436a-9bab-935519495dbb req-c334a189-11dc-4417-be3d-8926339c0e3d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051843 Oct 12 00:25:25.449299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 363/731] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:25.559737 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-90ea76dd-724c-4221-9bc8-8f6e8d3ebe2d tempest-TestMinimumBasicScenario-2079007867 tempest-TestMinimumBasicScenario-2079007867-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1585632205" status: 202 len: 0 microversion: 2.1 time: 0.118592 Oct 12 00:25:25.564493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 369/732] 10.222.0.36 () {58 vars in 1272 bytes} [Wed Oct 12 00:25:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1585632205 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:25:25.709166 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:25.710424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:25.717693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.718866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.720250 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.721491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.722324 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.723092 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.792681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:25.801492 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:25.805070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:25.805070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-cecb9f79-ab41-45c0-83a2-3aff863aab69 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1341 microversion: 2.20 time: 0.099997 Oct 12 00:25:25.805070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 364/733] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:25 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1341 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:25.860317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:25.861326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:25.876691 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.881495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.882014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.882824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.883215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.883656 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.927137 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:25.927676 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:25.928111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:25.928559 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lazy-loading 'fault' on Instance uuid 20228600-f497-4d8c-86c7-1ba7f1a986e0 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:25.980396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:25.989598 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c4af81ab-bd3b-4737-9c79-96c3abad7186 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1311 microversion: 2.1 time: 0.134402 Oct 12 00:25:25.990317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 370/734] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:25 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1311 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:26.159039 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:26.159981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:26.166360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:26.166926 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:26.167438 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:26.168384 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:26.175076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:26.175076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:26.339775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:26.344863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:26.354046 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-be8b080b-541f-442a-a877-cabfbb75a41e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.199582 Oct 12 00:25:26.356037 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 365/735] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:26 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:26.835744 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:26.836357 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:26.842275 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:26.843589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:26.843589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:26.843864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:26.844302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:26.844719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:26.978948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:26.987013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:26.988465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:26.989542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e6b94684-ffe5-439e-b49f-2b2e566d37a4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.157680 Oct 12 00:25:26.990103 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 371/736] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:26 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:27.013182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:27.014664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:27.022261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:27.022261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:27.022261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:27.022944 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:27.023432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:27.023857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:27.053259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:27.053655 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:27.054080 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:27.054516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lazy-loading 'fault' on Instance uuid 20228600-f497-4d8c-86c7-1ba7f1a986e0 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:27.099251 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:27.107068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5b9c0621-ee90-4bd3-8559-817101c8977d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 200 len: 1311 microversion: 2.1 time: 0.098122 Oct 12 00:25:27.107688 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 366/737] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:27 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:27.378672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:27.379285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:27.385481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:27.386032 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:27.386472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:27.387171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:27.387653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:27.388076 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:27.912444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:27.920795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-93cdd0b3-d0a8-4284-be24-a25fbde92bce tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1363 microversion: 2.1 time: 0.545966 Oct 12 00:25:27.921429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 372/738] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:27 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1363 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:28.016141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:28.016856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:28.023432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.027523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.027523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.027523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.027523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.027878 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.130228 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:28.130957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: 20228600-f497-4d8c-86c7-1ba7f1a986e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:28.137267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.137748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.138169 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.139887 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.140336 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.141107 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.157380 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] HTTP exception thrown: Instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 could not be found. Oct 12 00:25:28.158878 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Request method failure captured: Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 HTTP/1.1 Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg4D5QpA122m4lveLfp-9wK4wQY1TE92U5jGpsoHvTIDe3sVfW71KUvl95hjGK9nabV-xPoWv_cueB36pe1p0iuF5EEjQbKRkVvXU96pA9dHpMADtwbatpjx02JePAouRZp5PfqxNe6tBM68X2Kurf9NMVBV7WSgbG7GXeRsglkyD4 Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:25:28.159065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38c7ea1f3f9848b484a56cf74a2bd129", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: cdd87151f3af4a3bb1c3815db5d0e8fa Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 could not be found. Oct 12 00:25:28.160514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '20228600-f497-4d8c-86c7-1ba7f1a986e0'} Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 could not be found. Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:28.161465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 could not be found. Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 could not be found. Oct 12 00:25:28.162840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:25:28.164325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Returning 404 to user: Instance 20228600-f497-4d8c-86c7-1ba7f1a986e0 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:28.164325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6a859098-5e9b-4fc0-a0c2-bbd0b250e2df tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0" status: 404 len: 111 microversion: 2.1 time: 0.034162 Oct 12 00:25:28.164325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 373/739] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:28 2022] GET /compute/v2.1/servers/20228600-f497-4d8c-86c7-1ba7f1a986e0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 00:25:28.168984 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:28.169383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:28.172624 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:28.172624 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:28.174095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-60d33d07-6992-4585-b59a-c137c8f28c4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.162787 Oct 12 00:25:28.183720 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 367/740] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:28 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:28.183890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.183890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.183890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.183890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.184271 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.184271 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.210665 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:25:28.507813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:28.615794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-22ed0fad-5ed6-439b-ad7f-94bf116c7749 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 204 len: 0 microversion: 2.1 time: 0.450118 Oct 12 00:25:28.616646 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 374/741] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:25:28 2022] DELETE /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:25:28.625457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:28.626501 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:28.634039 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.634525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.634961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.635873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.636359 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.636782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.766686 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:28.774587 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c8702e2f-cf87-494a-a502-4da6a1f2e429 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.153580 Oct 12 00:25:28.775784 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 368/742] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:28 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:28.836864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-2711e102-c9aa-421a-b201-cf5ec6ce5e2a req-1b24a34b-7f6c-483b-aa05-fac1f1d6a582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facea60e-d753-4eda-b9f7-932b0cf5a63b", "tag": "ff37e4cb-00cf-4bd1-b77a-3dffa69e456e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:28.848118 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2711e102-c9aa-421a-b201-cf5ec6ce5e2a req-1b24a34b-7f6c-483b-aa05-fac1f1d6a582 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.848698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2711e102-c9aa-421a-b201-cf5ec6ce5e2a req-1b24a34b-7f6c-483b-aa05-fac1f1d6a582 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.854688 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2711e102-c9aa-421a-b201-cf5ec6ce5e2a req-1b24a34b-7f6c-483b-aa05-fac1f1d6a582 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.861673 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-2711e102-c9aa-421a-b201-cf5ec6ce5e2a req-1b24a34b-7f6c-483b-aa05-fac1f1d6a582 service nova] Creating event network-changed:ff37e4cb-00cf-4bd1-b77a-3dffa69e456e for instance facea60e-d753-4eda-b9f7-932b0cf5a63b on hv-cinder-84914 Oct 12 00:25:28.867401 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-2711e102-c9aa-421a-b201-cf5ec6ce5e2a req-1b24a34b-7f6c-483b-aa05-fac1f1d6a582 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092153 Oct 12 00:25:28.867956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 375/743] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:25:28.943436 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:28.944081 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:28.951196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.951985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.952596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:28.953482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:28.954160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:28.954589 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:29.097650 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:29.105799 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a35c47c4-674a-4113-a3f2-d6f80e6dfd7c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1548 microversion: 2.1 time: 0.166309 Oct 12 00:25:29.114950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 369/744] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:28 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:29.129771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:29.130427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:29.137095 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:29.137844 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:29.138814 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:29.139824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:29.140497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:29.141127 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:29.145696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:29.200964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:29.201780 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:29.208975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:29.210170 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:29.211073 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:29.211917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:29.212572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:29.213205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:29.259267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0f4cd83b-58ab-4087-a1a7-aef33a7ce84c tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134228 Oct 12 00:25:29.259899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 376/745] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Oct 12 00:25:29 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:29.358902 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:29.367810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:29.369247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:29.370551 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f4b0533b-b07f-4c18-925c-2baac8284559 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.173683 Oct 12 00:25:29.371284 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 370/746] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:29 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:25:29.798518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:29.799654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:29.817941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:29.818627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:29.819227 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:29.820285 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:29.820897 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:29.821641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:29.905738 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:30.196012 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=22 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:30.398713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:30.399889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:30.407989 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:30.408648 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:30.409077 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:30.409773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:30.410480 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:30.411304 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:30.474018 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:30.482268 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-399e28af-fdd7-48b3-9f54-eaaeb0ac449d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.689023 Oct 12 00:25:30.483337 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 377/747] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:29 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:30.547961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:30.557416 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:30.558151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:30.559543 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-98114a35-efe7-427c-b994-3788e616425a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.166494 Oct 12 00:25:30.560092 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 371/748] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:30 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:31.320593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-7edef450-7247-4325-9e5d-ee96d61d6b09 req-cce50f30-a518-49bb-beba-b62526459515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2e624a-ad19-4369-aebf-7af749828d71", "tag": "68692578-9ba0-4b5a-af9e-cb3c327ca4e7"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:31.330299 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7edef450-7247-4325-9e5d-ee96d61d6b09 req-cce50f30-a518-49bb-beba-b62526459515 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:31.335872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7edef450-7247-4325-9e5d-ee96d61d6b09 req-cce50f30-a518-49bb-beba-b62526459515 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:31.335872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7edef450-7247-4325-9e5d-ee96d61d6b09 req-cce50f30-a518-49bb-beba-b62526459515 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:31.342865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-7edef450-7247-4325-9e5d-ee96d61d6b09 req-cce50f30-a518-49bb-beba-b62526459515 service nova] Creating event network-changed:68692578-9ba0-4b5a-af9e-cb3c327ca4e7 for instance ca2e624a-ad19-4369-aebf-7af749828d71 on hv-cinder-84914 Oct 12 00:25:31.347847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-7edef450-7247-4325-9e5d-ee96d61d6b09 req-cce50f30-a518-49bb-beba-b62526459515 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030996 Oct 12 00:25:31.348663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 378/749] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:31.505127 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:31.505761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:31.512699 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:31.513326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:31.514131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:31.514894 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:31.515391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:31.515937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:31.589945 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:31.590980 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:31.600211 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:31.601139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:31.601572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:31.602496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:31.603149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:31.603852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:31.734522 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:31.743078 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-fef0fcfc-b00e-452e-ade3-ed6485ea3fc8 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.241832 Oct 12 00:25:31.756882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 372/750] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:31 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:31.914209 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:31.932664 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:31.934918 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:31.936650 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-29e105c9-1342-4a16-a33d-d86b8bfc642b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.351073 Oct 12 00:25:31.939550 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 379/751] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:31 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:32.661690 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a30cdb53-46bb-4e5c-87db-66996c795c0a"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:32.670846 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:32.683942 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:32.695857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:32.697985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:32.700472 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:32.701214 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:32.705921 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:32.770293 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:32.770953 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:32.780049 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:32.780998 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:32.781748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:32.782739 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:32.783338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:32.783926 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:32.861614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Invalid volume: volume a30cdb53-46bb-4e5c-87db-66996c795c0a is already attached to instances: 7e994443-5484-48d9-9a1b-e9662eb497e2 Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: POST /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments HTTP/1.1 Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 74 Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:25:32.869103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {"volumeAttachment": {"volumeId": "a30cdb53-46bb-4e5c-87db-66996c795c0a"}} Oct 12 00:25:32.870675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Invalid volume: volume a30cdb53-46bb-4e5c-87db-66996c795c0a is already attached to instances: 7e994443-5484-48d9-9a1b-e9662eb497e2 Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'server_id': '7e994443-5484-48d9-9a1b-e9662eb497e2', 'body': {'volumeAttachment': {'volumeId': 'a30cdb53-46bb-4e5c-87db-66996c795c0a'}}} Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a30cdb53-46bb-4e5c-87db-66996c795c0a is already attached to instances: 7e994443-5484-48d9-9a1b-e9662eb497e2 Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:32.871771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a30cdb53-46bb-4e5c-87db-66996c795c0a is already attached to instances: 7e994443-5484-48d9-9a1b-e9662eb497e2 Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:32.874001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:32.875605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:32.875605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:32.875605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:32.875605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a30cdb53-46bb-4e5c-87db-66996c795c0a is already attached to instances: 7e994443-5484-48d9-9a1b-e9662eb497e2 Oct 12 00:25:32.875605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:32.875605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 400 to user: Invalid volume: volume a30cdb53-46bb-4e5c-87db-66996c795c0a is already attached to instances: 7e994443-5484-48d9-9a1b-e9662eb497e2 {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:32.877611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ce1aaeef-a831-441f-9814-e7c39ba2845d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.221159 Oct 12 00:25:32.878334 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 373/752] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:25:32 2022] POST /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments => generated 174 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:25:32.966711 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:32.967422 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:32.980460 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:32.981524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:32.982045 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:32.982894 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:32.983461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:32.985020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:33.023359 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:33.034940 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4f87dc1b-8d27-464f-8e06-9edd56ade975 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1522 microversion: 2.1 time: 0.269426 Oct 12 00:25:33.043565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 380/753] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:32 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:33.046647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:33.047146 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:33.059075 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:33.059664 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:33.060179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:33.061487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:33.062170 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:33.062787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:33.159915 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'services' on Instance uuid 7e994443-5484-48d9-9a1b-e9662eb497e2 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:33.403902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0f1e1149-049a-4982-8dcd-da217c94ab49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments/a30cdb53-46bb-4e5c-87db-66996c795c0a" status: 202 len: 0 microversion: 2.1 time: 0.361425 Oct 12 00:25:33.404918 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 381/754] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:25:33 2022] DELETE /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments/a30cdb53-46bb-4e5c-87db-66996c795c0a => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:25:33.415501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:33.418735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:33.425740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:33.426225 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:33.426672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:33.427461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:33.427920 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:33.428370 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:33.463520 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-be5d7210-f2b8-4293-906d-672ffb0649f5 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054144 Oct 12 00:25:33.464101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 382/755] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:33 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:25:33.697907 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-3fd75f6a-04ea-4d8a-aad3-583d4e8d161f req-7951a028-7f4c-4eb8-91a8-e3c22bce7bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9bf92f4-feae-4c05-afff-d0daff3371e3", "name": "network-vif-deleted", "tag": "c00ed7a3-6f70-42f2-91d7-bc8ef378b584"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:33.708402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:33.708852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3fd75f6a-04ea-4d8a-aad3-583d4e8d161f req-7951a028-7f4c-4eb8-91a8-e3c22bce7bc6 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:33.709019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3fd75f6a-04ea-4d8a-aad3-583d4e8d161f req-7951a028-7f4c-4eb8-91a8-e3c22bce7bc6 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:33.709850 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3fd75f6a-04ea-4d8a-aad3-583d4e8d161f req-7951a028-7f4c-4eb8-91a8-e3c22bce7bc6 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:33.723924 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-3fd75f6a-04ea-4d8a-aad3-583d4e8d161f req-7951a028-7f4c-4eb8-91a8-e3c22bce7bc6 service nova] Creating event network-vif-deleted:c00ed7a3-6f70-42f2-91d7-bc8ef378b584 for instance f9bf92f4-feae-4c05-afff-d0daff3371e3 on hv-cinder-84914 Oct 12 00:25:33.724578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:33.726101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:33.727341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1ba1b7bd-1a53-4b98-bf71-e79b4bd12b54 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.767880 Oct 12 00:25:33.727997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 374/756] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:32 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:33.729148 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-3fd75f6a-04ea-4d8a-aad3-583d4e8d161f req-7951a028-7f4c-4eb8-91a8-e3c22bce7bc6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112012 Oct 12 00:25:33.729765 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 383/757] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:34.058158 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:34.058804 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:34.064764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:34.065233 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:34.065665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:34.066348 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:34.066802 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:34.067219 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:34.131584 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:34.140374 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bfbd4217-3bfd-4efa-8bde-20df3a8ef5fd tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1307 microversion: 2.1 time: 0.086210 Oct 12 00:25:34.140946 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 375/758] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:34 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1307 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:34.477167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:34.479508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:34.485745 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:34.486229 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:34.486662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:34.487360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:34.487866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:34.488291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:34.518462 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-30c05473-688a-4da1-b2c5-b4ec32d6e920 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Oct 12 00:25:34.519213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 384/759] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:34 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:34.753029 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:34.753666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:34.762273 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:34.762873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:34.763446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:34.764706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:34.765253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:34.765790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:34.895945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:34.904211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:34.905680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:34.906783 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-efce35e7-e751-4604-aaeb-a12061a96503 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.157746 Oct 12 00:25:34.907559 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 376/760] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:34 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:35.163280 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:35.166236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:35.181040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:35.181544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:35.181985 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:35.182695 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:35.184852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:35.185690 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:35.228837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:35.229679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:35.230560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:35.231172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lazy-loading 'fault' on Instance uuid f9bf92f4-feae-4c05-afff-d0daff3371e3 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:35.309471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdd87151f3af4a3bb1c3815db5d0e8fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38c7ea1f3f9848b484a56cf74a2bd129', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:35.321475 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9bda65ac-db11-4f76-a7c7-9668b0e840c0 tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 200 len: 1312 microversion: 2.1 time: 0.162169 Oct 12 00:25:35.322069 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 385/761] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:35 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:35.530977 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:35.533360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:35.539664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:35.540391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:35.540993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:35.541847 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:35.542469 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:35.543044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:35.608516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6d7272b8-82e8-4b28-9f2a-65b6d0202c3d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082043 Oct 12 00:25:35.609104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 377/762] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:35 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:35.933111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:35.933651 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:35.940394 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:35.940863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:35.941516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:35.942421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:35.942864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:35.943472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:36.177849 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:36.187504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:36.188855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:36.189976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-08ccc3b2-5e3c-45dc-be54-c3b168511a3c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.260768 Oct 12 00:25:36.190535 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 386/763] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:35 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:36.345717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:36.346424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] [instance: f9bf92f4-feae-4c05-afff-d0daff3371e3] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:36.352918 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:36.353403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:36.353842 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:36.354537 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:36.354990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:36.355489 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:36.369586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] HTTP exception thrown: Instance f9bf92f4-feae-4c05-afff-d0daff3371e3 could not be found. Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Request method failure captured: Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 HTTP/1.1 Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg4D5QpA122m4lveLfp-9wK4wQY1TE92U5jGpsoHvTIDe3sVfW71KUvl95hjGK9nabV-xPoWv_cueB36pe1p0iuF5EEjQbKRkVvXU96pA9dHpMADtwbatpjx02JePAouRZp5PfqxNe6tBM68X2Kurf9NMVBV7WSgbG7GXeRsglkyD4 Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:25:36.371300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_38c7ea1f3f9848b484a56cf74a2bd129", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/38c7ea1f3f9848b484a56cf74a2bd129"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 38c7ea1f3f9848b484a56cf74a2bd129 Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1663006752 Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: cdd87151f3af4a3bb1c3815db5d0e8fa Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1663006752-project Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance f9bf92f4-feae-4c05-afff-d0daff3371e3 could not be found. Oct 12 00:25:36.372792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'f9bf92f4-feae-4c05-afff-d0daff3371e3'} Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9bf92f4-feae-4c05-afff-d0daff3371e3 could not be found. Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:36.374097 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9bf92f4-feae-4c05-afff-d0daff3371e3 could not be found. Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9bf92f4-feae-4c05-afff-d0daff3371e3 could not be found. Oct 12 00:25:36.375310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:36.376410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] Returning 404 to user: Instance f9bf92f4-feae-4c05-afff-d0daff3371e3 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:36.376410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7dc8b15e-b93d-40e6-a846-16ecd069440d tempest-ServerRescueNegativeTestJSON-1663006752 tempest-ServerRescueNegativeTestJSON-1663006752-project] 10.222.0.36 "GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3" status: 404 len: 111 microversion: 2.1 time: 0.030897 Oct 12 00:25:36.376410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 378/764] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:36 2022] GET /compute/v2.1/servers/f9bf92f4-feae-4c05-afff-d0daff3371e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:25:36.621421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:36.624821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:36.630900 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:36.632058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:36.632688 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:36.633590 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:36.634405 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:36.634604 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:36.668388 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-23fd6341-69a1-4427-8cb1-e34f0a1b5aaf tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050953 Oct 12 00:25:36.673406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 387/765] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:25:36 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:25:36.745145 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:36.745638 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:36.753466 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:36.754166 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:36.754783 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:36.755690 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:36.756297 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:36.756879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:36.787795 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:25:37.097123 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-55012599-ebba-4941-84b1-a942037f4664 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 204 len: 0 microversion: 2.1 time: 0.355742 Oct 12 00:25:37.098495 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 379/766] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:25:36 2022] DELETE /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:25:37.106582 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:37.107191 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:37.115354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:37.116073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:37.116793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:37.117618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:37.122314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:37.122986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:37.215761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:37.216363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:37.225713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:37.226424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:37.227077 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:37.228020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:37.228703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:37.229365 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:37.463540 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:37.481388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:37.484622 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:37.487705 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-00861e20-a8a2-460b-84f0-833d2ab8a04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.275264 Oct 12 00:25:37.488505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 380/767] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:37 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:37.631101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:37.640629 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4bfa7e46-d517-423a-b55d-d608ed5415e2 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1680 microversion: 2.1 time: 0.537838 Oct 12 00:25:37.641281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 388/768] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:37 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1680 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:38.512647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:38.515238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:38.522572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:38.523356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:38.524144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:38.525374 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:38.526117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:38.526764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:38.532362 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:38.667042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:38.668183 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:38.676677 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:38.677169 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:38.679651 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:38.680685 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:38.682479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:38.683108 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:38.745907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:38.755732 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:38.758447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:38.759939 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-efeef1a2-bb10-41b1-8797-736c74ea68e8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.251290 Oct 12 00:25:38.760688 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 381/769] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:38 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:38.986686 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:38.996859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-95dff716-1370-4448-a2d0-18209b7f230e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1680 microversion: 2.1 time: 0.332804 Oct 12 00:25:38.997470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 389/770] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:38 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1680 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:39.567283 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-e33d33be-bca8-4349-9c4a-c1dd1f30da67 req-48649c86-0a30-4cfa-b7b4-1afdbbbaf012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facea60e-d753-4eda-b9f7-932b0cf5a63b", "name": "network-vif-plugged", "status": "completed", "tag": "ff37e4cb-00cf-4bd1-b77a-3dffa69e456e"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:39.580664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e33d33be-bca8-4349-9c4a-c1dd1f30da67 req-48649c86-0a30-4cfa-b7b4-1afdbbbaf012 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:39.581452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e33d33be-bca8-4349-9c4a-c1dd1f30da67 req-48649c86-0a30-4cfa-b7b4-1afdbbbaf012 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:39.581981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e33d33be-bca8-4349-9c4a-c1dd1f30da67 req-48649c86-0a30-4cfa-b7b4-1afdbbbaf012 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:39.597210 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-e33d33be-bca8-4349-9c4a-c1dd1f30da67 req-48649c86-0a30-4cfa-b7b4-1afdbbbaf012 service nova] Creating event network-vif-plugged:ff37e4cb-00cf-4bd1-b77a-3dffa69e456e for instance facea60e-d753-4eda-b9f7-932b0cf5a63b on hv-cinder-84914 Oct 12 00:25:39.602835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-e33d33be-bca8-4349-9c4a-c1dd1f30da67 req-48649c86-0a30-4cfa-b7b4-1afdbbbaf012 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039620 Oct 12 00:25:39.603863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 382/771] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:25:39.787393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:39.788024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:39.796491 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:39.796987 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:39.797431 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:39.798136 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:39.798814 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:39.799238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:39.993320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:40.005487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:40.007678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:40.008927 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7d64eb4a-59a4-4ee3-ab7c-b62403e1f3b9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.226583 Oct 12 00:25:40.009608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 390/772] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:39 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:40.028095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:40.028095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:40.035322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:40.036865 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:40.037489 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:40.038431 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:40.039173 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:40.039856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:40.343941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:40.356488 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-88e4316e-62ee-4e82-b390-50c5f3b106ed tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1613 microversion: 2.1 time: 0.333666 Oct 12 00:25:40.363602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 383/773] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:40 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1613 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:40.844395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-90c29148-5cf1-400f-be96-e20a5e7c84c6 req-d0a03ba3-07e3-4ef9-bcc6-78e9131f349e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e994443-5484-48d9-9a1b-e9662eb497e2", "name": "network-vif-deleted", "tag": "d4634f29-c1d0-4738-98cb-502e6977b79b"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:40.868012 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-90c29148-5cf1-400f-be96-e20a5e7c84c6 req-d0a03ba3-07e3-4ef9-bcc6-78e9131f349e service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:40.870639 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-90c29148-5cf1-400f-be96-e20a5e7c84c6 req-d0a03ba3-07e3-4ef9-bcc6-78e9131f349e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:40.871843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-90c29148-5cf1-400f-be96-e20a5e7c84c6 req-d0a03ba3-07e3-4ef9-bcc6-78e9131f349e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:40.913696 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-90c29148-5cf1-400f-be96-e20a5e7c84c6 req-d0a03ba3-07e3-4ef9-bcc6-78e9131f349e service nova] Creating event network-vif-deleted:d4634f29-c1d0-4738-98cb-502e6977b79b for instance 7e994443-5484-48d9-9a1b-e9662eb497e2 on hv-cinder-84914 Oct 12 00:25:40.922959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-90c29148-5cf1-400f-be96-e20a5e7c84c6 req-d0a03ba3-07e3-4ef9-bcc6-78e9131f349e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083248 Oct 12 00:25:40.924072 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 391/774] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:41.041879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:41.042571 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:41.052256 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:41.052746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:41.053276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:41.053977 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:41.054444 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:41.054861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:41.189310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:41.197601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:41.199028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:41.200136 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e7857b3c-d65f-4bf9-b71e-d7cf6ddf96cb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1407 microversion: 2.20 time: 0.163708 Oct 12 00:25:41.200694 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 384/775] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:41 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:41.388015 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:41.389845 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:41.398402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:41.399217 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:41.399876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:41.400797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:41.401430 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:41.402921 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:41.475351 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:41.489066 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ecf52eea-96f4-4c67-ad24-1e617843c2db tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1325 microversion: 2.1 time: 0.102213 Oct 12 00:25:41.489066 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 392/776] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:41 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:42.225657 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:42.226263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:42.234602 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:42.235125 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:42.235595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:42.236293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:42.236868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:42.237226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:42.374911 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:42.383407 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:42.384993 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:42.386144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-79e1192f-db00-4f06-9da2-5662b610d902 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1598 microversion: 2.20 time: 0.164485 Oct 12 00:25:42.386700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 385/777] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:25:42 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:25:42.413567 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:42.414072 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:42.419955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:42.420957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:42.421421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:42.422111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:42.422557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:42.422972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:42.502725 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7874980a-cff0-4b0d-b93c-c2a5cceefc4d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092784 Oct 12 00:25:42.507884 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 393/778] 10.222.0.36 () {60 vars in 1316 bytes} [Wed Oct 12 00:25:42 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:25:42.514916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:42.515585 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:42.523258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:42.524116 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:42.524702 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:42.525568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:42.526203 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:42.526629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:42.563386 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:42.563892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:42.564514 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:42.564964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 7e994443-5484-48d9-9a1b-e9662eb497e2 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:25:42.646113 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:42.657153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c58e5ebc-660f-484d-a058-0c0753c93b49 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 200 len: 1330 microversion: 2.1 time: 0.155396 Oct 12 00:25:42.657670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 386/779] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:42 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 1330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:43.559313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-563bdeee-0758-4aa4-a9d8-d6ae53761f75 req-6578b6af-3a07-48ad-b92b-58377b5c1781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "facea60e-d753-4eda-b9f7-932b0cf5a63b", "tag": "ff37e4cb-00cf-4bd1-b77a-3dffa69e456e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:43.569823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-563bdeee-0758-4aa4-a9d8-d6ae53761f75 req-6578b6af-3a07-48ad-b92b-58377b5c1781 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:43.570550 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-563bdeee-0758-4aa4-a9d8-d6ae53761f75 req-6578b6af-3a07-48ad-b92b-58377b5c1781 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:43.571126 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-563bdeee-0758-4aa4-a9d8-d6ae53761f75 req-6578b6af-3a07-48ad-b92b-58377b5c1781 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:43.583110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-563bdeee-0758-4aa4-a9d8-d6ae53761f75 req-6578b6af-3a07-48ad-b92b-58377b5c1781 service nova] Creating event network-changed:ff37e4cb-00cf-4bd1-b77a-3dffa69e456e for instance facea60e-d753-4eda-b9f7-932b0cf5a63b on hv-cinder-84914 Oct 12 00:25:43.588387 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-563bdeee-0758-4aa4-a9d8-d6ae53761f75 req-6578b6af-3a07-48ad-b92b-58377b5c1781 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032813 Oct 12 00:25:43.589055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 394/780] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:43.684680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:43.685557 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:43.692985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:43.693609 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:43.694286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:43.695052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:43.695603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:43.696346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:43.710422 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 HTTP/1.1 Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:25:43.712215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:25:43.713546 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '7e994443-5484-48d9-9a1b-e9662eb497e2'} Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:25:43.714249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:25:43.715524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:25:43.716671 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:25:43.716671 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8318eb3f-71a8-49f0-b86a-be577efc48e1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 404 len: 111 microversion: 2.1 time: 0.032845 Oct 12 00:25:43.716671 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 387/781] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:43 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:25:43.723450 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5562e356-fbf4-4862-8b87-3c1e3392af3b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '.version_select at 0x7f2fe8d12a60>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:43.793097 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5562e356-fbf4-4862-8b87-3c1e3392af3b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609081507" status: 202 len: 0 microversion: 2.1 time: 0.074048 Oct 12 00:25:43.793726 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 395/782] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Oct 12 00:25:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609081507 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:25:44.495788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e4ac3427-5397-4275-9b4a-058f5115c15d tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8cc6f70>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:44.546488 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c4f8f036-fec0-456c-b6b6-796c5ae8b558 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: .version_select at 0x7f2fe8cca5e0>, body: {"keypair": {"name": "tempest-keypair-376320981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7IK67Zj79RwhuT0SBAKgeXDHUIN6u9XyTiFnOk0/09KjvmJwoUU52eG+E/f5rb3T0P3pWkP5vKvxD7nMU3DWHmkglRCbIBjXbj2GcGSLi3mJ24t8t5kzpCK2/89X3H7g=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:44.562016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e4ac3427-5397-4275-9b4a-058f5115c15d tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/48bd4b20-9a06-4af6-bf99-ac9a77c1df50" status: 200 len: 351 microversion: 2.1 time: 0.069911 Oct 12 00:25:44.563059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-c4f8f036-fec0-456c-b6b6-796c5ae8b558 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for project 10160596b45c49249155b0c2585e70bb. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:25:44.563645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 388/783] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:25:44 2022] GET /compute/v2.1/os-volumes/48bd4b20-9a06-4af6-bf99-ac9a77c1df50 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:44.568241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-c4f8f036-fec0-456c-b6b6-796c5ae8b558 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for user de766cb582ba4c18b1fda9bf4ad43f65 and project 10160596b45c49249155b0c2585e70bb. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:25:44.646016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c4f8f036-fec0-456c-b6b6-796c5ae8b558 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104858 Oct 12 00:25:44.646828 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 396/784] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:25:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:46.321442 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-78aa08fd-8af8-4cec-9c9c-39183568944c tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8cc0ee0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:46.369616 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-78aa08fd-8af8-4cec-9c9c-39183568944c tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/cd37f24b-7134-488d-81c4-2956a09f897b" status: 200 len: 351 microversion: 2.1 time: 0.052425 Oct 12 00:25:46.370315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 389/785] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:25:46 2022] GET /compute/v2.1/os-volumes/cd37f24b-7134-488d-81c4-2956a09f897b => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:46.945260 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-684916290", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7f2d8cc-4d82-4295-a149-404a55bcd20c"}], "security_groups": [{"name": "tempest-securitygroup--634474965"}], "key_name": "tempest-keypair-376320981", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:47.049513 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] validate_networks() for [('a7f2d8cc-4d82-4295-a149-404a55bcd20c', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:25:47.409055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:25:47.409510 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:25:47.409980 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:25:47.410414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:25:47.410820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:25:47.419706 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:47.420163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:47.420610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:47.421321 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:47.421859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:47.422276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:47.429486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:47.439937 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for project 10160596b45c49249155b0c2585e70bb. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:25:47.443830 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Getting quotas for user de766cb582ba4c18b1fda9bf4ad43f65 and project 10160596b45c49249155b0c2585e70bb. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:25:47.455326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:25:47.457743 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:25:47.633092 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4611f9b4-7294-45a7-9c38-745de9efc4d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.692396 Oct 12 00:25:47.633730 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 397/786] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:25:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:25:47.646044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3c782af6-a46f-4515-b77a-9c26b3410361 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:47.646657 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3c782af6-a46f-4515-b77a-9c26b3410361 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:47.700199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3c782af6-a46f-4515-b77a-9c26b3410361 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:47.707723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3c782af6-a46f-4515-b77a-9c26b3410361 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1240 microversion: 2.1 time: 0.066023 Oct 12 00:25:47.708286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 390/787] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:47 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:47.988907 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-60d5146a-194b-404a-9952-44feab98231c tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8ce4f70>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.038924 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-60d5146a-194b-404a-9952-44feab98231c tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/701b8bc0-fa60-4992-8741-89b3b51eda9a" status: 200 len: 350 microversion: 2.1 time: 0.053879 Oct 12 00:25:48.039631 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 398/788] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:25:47 2022] GET /compute/v2.1/os-volumes/701b8bc0-fa60-4992-8741-89b3b51eda9a => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:48.052624 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-75a5ccda-8e88-462a-b574-bf58652c6d40 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8e52280>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.134330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-75a5ccda-8e88-462a-b574-bf58652c6d40 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085345 Oct 12 00:25:48.134915 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 391/789] 10.222.0.36 () {58 vars in 1134 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:48.149476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ad4a0741-71a0-4cbf-99e2-83289540e1fd tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8ce43a0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.230729 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ad4a0741-71a0-4cbf-99e2-83289540e1fd tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085237 Oct 12 00:25:48.231322 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 399/790] 10.222.0.36 () {58 vars in 1149 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:48.245755 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5b367ac7-f578-4a4f-b28a-ce548b721e24 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8d34670>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.329015 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5b367ac7-f578-4a4f-b28a-ce548b721e24 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087064 Oct 12 00:25:48.329588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 392/791] 10.222.0.36 () {58 vars in 1134 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:48.343296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-45e6cd07-9f8d-405e-bb46-934ac6d5a81b tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8eaec10>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.424490 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-45e6cd07-9f8d-405e-bb46-934ac6d5a81b tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085657 Oct 12 00:25:48.425070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 400/792] 10.222.0.36 () {58 vars in 1167 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:48.438524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ffc5011f-6f20-403a-ae22-ccf0e54f14b0 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8d9b5e0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.522438 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ffc5011f-6f20-403a-ae22-ccf0e54f14b0 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087633 Oct 12 00:25:48.523015 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 393/793] 10.222.0.36 () {58 vars in 1170 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:48.536492 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f12e6a21-0093-4acb-b3f4-d53e1d9509f0 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8d12d30>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.617794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f12e6a21-0093-4acb-b3f4-d53e1d9509f0 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084941 Oct 12 00:25:48.618427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 401/794] 10.222.0.36 () {58 vars in 1155 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:48.632199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b4e0ab93-5d6f-4885-b46a-22a950181340 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8cc0ee0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.713933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b4e0ab93-5d6f-4885-b46a-22a950181340 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085405 Oct 12 00:25:48.714889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 394/795] 10.222.0.36 () {58 vars in 1188 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:48.728565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-59d06980-c047-4c8b-9f86-0d2896890e43 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] Calling method '.version_select at 0x7f2fe8cca040>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.729824 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:48.730429 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:48.737037 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:48.737523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:48.737953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:48.738695 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:48.739064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:48.739558 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:48.803827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:48.813451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-89a1f1af-e154-4f8c-9f45-384224631695 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1244 microversion: 2.1 time: 0.087142 Oct 12 00:25:48.814056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 395/796] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:25:48.962882 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-59d06980-c047-4c8b-9f86-0d2896890e43 tempest-VolumesTestJSON-1728935670 tempest-VolumesTestJSON-1728935670-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.238350 Oct 12 00:25:48.963561 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 402/797] 10.222.0.36 () {58 vars in 1155 bytes} [Wed Oct 12 00:25:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:49.837118 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:49.837759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:49.844667 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:49.848391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:49.848391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:49.848391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:49.848391 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:49.848722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:49.919899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:49.927453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-918b44de-8438-442d-b5a4-fc638cc376a0 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1310 microversion: 2.1 time: 0.094276 Oct 12 00:25:49.928661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 396/798] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:49 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:50.950560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:50.951090 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:50.958130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:50.958605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:50.959034 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:50.959750 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:50.960242 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:50.960661 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:51.091138 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:51.099718 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2d0790e4-fdf0-4278-a7b1-d179a035ce7f tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.153136 Oct 12 00:25:51.100423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 403/799] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:50 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:51.633532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-41f2835e-5586-4b20-a691-b481248acf03 req-83f43c57-7d5f-4c87-9e3e-3d5758ea000e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731e899f-66f8-474a-9ebb-adc979dbeb13", "tag": "ae56abca-71b5-4952-be55-bff130c4bc5e"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:51.640105 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:51.645174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-41f2835e-5586-4b20-a691-b481248acf03 req-83f43c57-7d5f-4c87-9e3e-3d5758ea000e service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:51.645700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-41f2835e-5586-4b20-a691-b481248acf03 req-83f43c57-7d5f-4c87-9e3e-3d5758ea000e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:51.646306 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-41f2835e-5586-4b20-a691-b481248acf03 req-83f43c57-7d5f-4c87-9e3e-3d5758ea000e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:51.658268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-41f2835e-5586-4b20-a691-b481248acf03 req-83f43c57-7d5f-4c87-9e3e-3d5758ea000e service nova] Creating event network-changed:ae56abca-71b5-4952-be55-bff130c4bc5e for instance 731e899f-66f8-474a-9ebb-adc979dbeb13 on hv-cinder-84914 Oct 12 00:25:51.663278 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-41f2835e-5586-4b20-a691-b481248acf03 req-83f43c57-7d5f-4c87-9e3e-3d5758ea000e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033393 Oct 12 00:25:51.663904 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 397/800] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:25:52.122911 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:52.124241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:52.130312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:52.130787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:52.131215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:52.131962 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:52.132407 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:52.132834 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:52.266397 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:52.274174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-388f79c7-da38-404c-bc77-d506585f0c7e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.155106 Oct 12 00:25:52.274775 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 404/801] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:52 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:53.297741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:53.298533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:53.305747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:53.306229 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:53.306662 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:53.307469 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:53.307927 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:53.308352 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:53.458298 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:53.466068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ccd408ab-2322-4fd3-b44f-da4b14915b6b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.172537 Oct 12 00:25:53.466641 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 398/802] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:53 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:54.487650 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:54.488262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:54.494378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:54.494859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:54.495286 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:54.496223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:54.496468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:54.499415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:54.636303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:54.645289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8e2718a8-196f-490e-880e-dfcb8d2a7642 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.161454 Oct 12 00:25:54.645933 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 405/803] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:54 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:55.667738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:55.668348 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:55.679319 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:55.679319 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:55.679319 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:55.679319 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:55.679739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:55.679739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:55.809950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:55.817552 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f58e0653-9aa6-447d-abf4-87e540d2f751 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.153624 Oct 12 00:25:55.818185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 399/804] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:55 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:56.840471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:56.841081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:56.847563 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:56.848039 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:56.848467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:56.849149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:56.849595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:56.850015 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:56.977257 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:56.985444 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2c46b0c0-593c-40be-8f6b-d269fb149260 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.148807 Oct 12 00:25:56.986012 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 406/805] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:56 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:57.705203 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:57.724984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-51b7b7b2-cf9b-480f-897a-57ddc39ae400 req-1e14873d-c6e9-41da-8f8b-1cba46426e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731e899f-66f8-474a-9ebb-adc979dbeb13", "name": "network-vif-plugged", "status": "completed", "tag": "ae56abca-71b5-4952-be55-bff130c4bc5e"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:25:57.734541 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-51b7b7b2-cf9b-480f-897a-57ddc39ae400 req-1e14873d-c6e9-41da-8f8b-1cba46426e2b service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:57.735012 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-51b7b7b2-cf9b-480f-897a-57ddc39ae400 req-1e14873d-c6e9-41da-8f8b-1cba46426e2b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:57.735762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-51b7b7b2-cf9b-480f-897a-57ddc39ae400 req-1e14873d-c6e9-41da-8f8b-1cba46426e2b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:57.749586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-51b7b7b2-cf9b-480f-897a-57ddc39ae400 req-1e14873d-c6e9-41da-8f8b-1cba46426e2b service nova] Creating event network-vif-plugged:ae56abca-71b5-4952-be55-bff130c4bc5e for instance 731e899f-66f8-474a-9ebb-adc979dbeb13 on hv-cinder-84914 Oct 12 00:25:57.754769 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-51b7b7b2-cf9b-480f-897a-57ddc39ae400 req-1e14873d-c6e9-41da-8f8b-1cba46426e2b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160887 Oct 12 00:25:57.755455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 400/806] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:25:58.007077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:58.007714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:58.009538 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:58.010205 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=10 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:25:58.015337 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:58.017986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:58.017986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:58.017986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:58.017986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:58.018314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:58.151297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:58.158963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1cb6e81f-2a14-4dd7-a345-0f425c577f65 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.155900 Oct 12 00:25:58.159551 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 407/807] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:58 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:25:59.183279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:25:59.184028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:25:59.190708 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:59.191183 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:59.191632 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:59.192317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:25:59.192763 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:25:59.193181 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:25:59.323847 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:25:59.332070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6a8921e8-29f2-4f75-8b0d-f8243e6898f1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.153825 Oct 12 00:25:59.332627 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 401/808] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:25:59 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:00.354007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:00.354611 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:00.356453 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:00.361062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:00.361534 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:00.372419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:00.372419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:00.372419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:00.372419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:00.490876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:00.498986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-16d5108f-3bc2-4153-94a8-432a5e6f1579 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.148896 Oct 12 00:26:00.499570 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 408/809] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:00 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:01.521364 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:01.521887 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:01.528671 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:01.532209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:01.532209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:01.532209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:01.532209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:01.532534 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:01.658978 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:01.666594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d034ca21-54c9-48b9-af92-f2b1bb827a89 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1365 microversion: 2.1 time: 0.149140 Oct 12 00:26:01.667171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 402/810] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:01 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:02.689684 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:02.690320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:02.696548 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:02.697030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:02.697460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:02.698149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:02.698598 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:02.699117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:02.825931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:02.833588 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-30e91dc1-1705-49fb-a63e-8a0505b9b4ff tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1555 microversion: 2.1 time: 0.148316 Oct 12 00:26:02.834153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 409/811] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:02 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:02.855979 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:02.856466 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:02.863384 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:02.863864 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:02.864301 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:02.865025 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:02.865465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:02.865880 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:02.947611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-343ccf26-03e1-4208-9a0a-5f54b82bbf44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095350 Oct 12 00:26:02.948196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 403/812] 10.222.0.36 () {58 vars in 1275 bytes} [Wed Oct 12 00:26:02 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:03.944474 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-392e84e6-bcfe-4bc2-b546-72335b0a4b12 req-dad50cb0-104d-42c3-9eb4-25d719f46e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731e899f-66f8-474a-9ebb-adc979dbeb13", "tag": "ae56abca-71b5-4952-be55-bff130c4bc5e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:26:03.953891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-392e84e6-bcfe-4bc2-b546-72335b0a4b12 req-dad50cb0-104d-42c3-9eb4-25d719f46e7e service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:03.954437 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-392e84e6-bcfe-4bc2-b546-72335b0a4b12 req-dad50cb0-104d-42c3-9eb4-25d719f46e7e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:03.954868 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-392e84e6-bcfe-4bc2-b546-72335b0a4b12 req-dad50cb0-104d-42c3-9eb4-25d719f46e7e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:03.965715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-392e84e6-bcfe-4bc2-b546-72335b0a4b12 req-dad50cb0-104d-42c3-9eb4-25d719f46e7e service nova] Creating event network-changed:ae56abca-71b5-4952-be55-bff130c4bc5e for instance 731e899f-66f8-474a-9ebb-adc979dbeb13 on hv-cinder-84914 Oct 12 00:26:03.970743 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-392e84e6-bcfe-4bc2-b546-72335b0a4b12 req-dad50cb0-104d-42c3-9eb4-25d719f46e7e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029919 Oct 12 00:26:03.971328 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 410/813] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:15.194488 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=13 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:15.195249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=78 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:15.199161 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:15.199677 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:15.206873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:15.206873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:15.206873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:15.207437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:15.207882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:15.208297 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:15.236741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9439de16-d9de-44f1-a5c7-2caa0c2b0a26 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/ips" status: 200 len: 145 microversion: 2.1 time: 0.038563 Oct 12 00:26:15.236741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 404/814] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:26:15 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:18.982280 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=5 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:18.983024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=44 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:18.988685 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3bb5843-0e91-4de1-8c5b-43fb8454ba62"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:26:18.991063 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:18.997067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:18.997545 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:18.997960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:18.998641 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:18.999083 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:18.999545 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:19.710748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-91345da8-d64a-4668-b6ad-f25eaa444409 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729254 Oct 12 00:26:19.711294 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 411/815] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:26:18 2022] POST /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments => generated 194 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:30.413083 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:30.415340 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:30.417872 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:30.422664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:30.423138 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:30.423611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:30.424296 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:30.424746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:30.425170 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:30.454645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d6643aba-6eba-4e24-872d-d06176939dff tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Oct 12 00:26:30.455833 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 405/816] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:26:30 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:30.464213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:30.465040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:30.469207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:30.469813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:30.475877 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:30.476415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:30.476851 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:30.477542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:30.478001 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:30.478415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:30.507167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a2b343ac-7ceb-43bd-a979-ae1e32b507cd tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/f3bb5843-0e91-4de1-8c5b-43fb8454ba62" status: 200 len: 194 microversion: 2.1 time: 0.044499 Oct 12 00:26:30.507794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 412/817] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Oct 12 00:26:30 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/f3bb5843-0e91-4de1-8c5b-43fb8454ba62 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:32.098630 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "828debb9-9a7e-49fe-bd02-ec4007ffae42"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:26:32.100968 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:32.108299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:32.108773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:32.109257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:32.109939 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:32.110383 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:32.110795 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:32.894032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-99066e7d-cc40-4b5b-b047-857d30b57a77 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "POST /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799546 Oct 12 00:26:32.894645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 406/818] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:26:32 2022] POST /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:36.752430 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:36.752984 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:36.759534 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:36.760011 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:36.760442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:36.761120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:36.761566 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:36.761981 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:36.786378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-79d5b5a9-7f9d-46df-84fa-a8c6cbb43dfd tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/ips" status: 200 len: 151 microversion: 2.20 time: 0.267227 Oct 12 00:26:36.787044 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 413/819] 10.222.0.36 () {60 vars in 1289 bytes} [Wed Oct 12 00:26:36 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/ips => generated 151 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 00:26:38.888000 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:26:38.888618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:38.896822 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:38.896822 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:38.896822 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:38.897313 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:38.897760 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:38.898181 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:38.921812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lazy-loading 'flavor' on Instance uuid facea60e-d753-4eda-b9f7-932b0cf5a63b {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:26:39.443825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0939fb49-6e7c-4c01-bdb7-83fa2d7c5a00 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/action" status: 202 len: 0 microversion: 2.20 time: 0.560405 Oct 12 00:26:39.444416 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 407/820] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Oct 12 00:26:38 2022] POST /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:26:39.452681 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:39.454184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:39.460163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:39.460721 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:39.461352 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:39.462051 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:39.462499 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:39.462919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:39.599004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:39.607152 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:39.608620 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:39.609774 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bf467a02-5cbc-4308-8903-328bc35f236f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.161067 Oct 12 00:26:39.610329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 414/821] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:39 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:40.636779 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:40.637414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:40.644042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:40.644520 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:40.644952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:40.645637 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:40.646085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:40.646507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:40.775240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:40.781263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:40.782710 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:40.783897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-62fd1cb6-0d90-4bc9-9b6c-b29ec6fab6a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.152018 Oct 12 00:26:40.784447 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 408/822] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:40 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:26:41.809893 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:41.810494 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:41.817010 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:41.817468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:41.817898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:41.818576 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:41.819019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:41.819464 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:41.945708 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:41.953556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:41.954996 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:41.956669 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6393a29a-17bf-4ebf-b571-376e2f93b4c8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.150655 Oct 12 00:26:41.957225 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 415/823] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:41 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:42.983342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:42.983914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:42.991425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:42.991957 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:42.992557 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:42.993322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:42.993770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:42.994189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:43.124707 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:43.132693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:43.134117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:43.135261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5cabdf56-a543-40b1-a150-be3f945e2fbc tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.156728 Oct 12 00:26:43.135842 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 409/824] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:42 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:43.626530 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:43.629382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:43.635977 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:43.636450 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:43.636880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:43.637564 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:43.638013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:43.638463 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:43.668555 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aa5105cf-1b40-4757-8119-6a68c3b02dd9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045979 Oct 12 00:26:43.669105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 416/825] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:26:43 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:43.814831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:43.815874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:43.821896 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:43.822493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:43.823008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:43.823828 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:43.824292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:43.824720 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:43.854215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e0d9df39-1eaf-40c5-a32d-1a8e4065272d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/f3bb5843-0e91-4de1-8c5b-43fb8454ba62" status: 200 len: 194 microversion: 2.1 time: 0.043448 Oct 12 00:26:43.854859 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 410/826] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Oct 12 00:26:43 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/f3bb5843-0e91-4de1-8c5b-43fb8454ba62 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:43.865256 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:43.865741 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:43.871598 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:43.872078 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:43.872519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:43.873182 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:43.873627 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:43.874042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:43.956674 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'services' on Instance uuid ca2e624a-ad19-4369-aebf-7af749828d71 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:26:44.145441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-742a0aef-da99-4355-8b08-571d0819fcb5 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/f3bb5843-0e91-4de1-8c5b-43fb8454ba62" status: 202 len: 0 microversion: 2.1 time: 0.283901 Oct 12 00:26:44.146022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 417/827] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:26:43 2022] DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/f3bb5843-0e91-4de1-8c5b-43fb8454ba62 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:26:44.162585 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:44.163195 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:44.169222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:44.169832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:44.170124 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:44.170817 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:44.171258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:44.171709 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:44.307850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:44.316568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:44.317997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:44.319144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-085e35ff-cc7b-4e65-8c29-4b7a8024df5d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.162079 Oct 12 00:26:44.319724 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 411/828] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:44 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:45.346758 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:45.347988 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:45.354094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:45.354567 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:45.355009 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:45.355699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:45.356143 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:45.356557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:45.498659 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:45.506799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:45.508249 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:45.509382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-def930dc-0543-4626-8e51-69453238f159 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.167488 Oct 12 00:26:45.509927 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 418/829] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:45 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:46.332005 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:46.332508 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:46.338775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:46.339252 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:46.339712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:46.340393 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:46.340840 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:46.341258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:46.369586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-fee154b6-7b71-468f-9179-4761e0c715fe tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/828debb9-9a7e-49fe-bd02-ec4007ffae42" status: 200 len: 194 microversion: 2.1 time: 0.041446 Oct 12 00:26:46.370159 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 412/830] 10.222.0.36 () {58 vars in 1413 bytes} [Wed Oct 12 00:26:46 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/828debb9-9a7e-49fe-bd02-ec4007ffae42 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:46.381119 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:46.381607 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:46.387968 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:46.388446 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:46.388874 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:46.389558 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:46.390007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:46.390426 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:46.469967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'services' on Instance uuid ca2e624a-ad19-4369-aebf-7af749828d71 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:26:46.539804 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:46.539804 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:46.544142 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:46.544715 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:46.545151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:46.545856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:46.546311 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:46.546748 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:46.676957 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:46.684907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:46.686334 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:46.687643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-49ce4f96-6410-4f87-839c-cba2b9a431a0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.154948 Oct 12 00:26:46.688151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 413/831] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:46 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:26:46.695572 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-53fcaf63-5d56-4b2b-988c-38dbfabc972e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/828debb9-9a7e-49fe-bd02-ec4007ffae42" status: 202 len: 0 microversion: 2.1 time: 0.318846 Oct 12 00:26:46.696140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 419/832] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:26:46 2022] DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments/828debb9-9a7e-49fe-bd02-ec4007ffae42 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:26:47.691952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:47.692455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:47.699209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:47.699929 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:47.700388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:47.701143 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:47.701584 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:47.702056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:47.713805 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:47.714577 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:47.722182 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:47.722886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:47.723556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:47.724255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:47.724855 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:47.725427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:47.731873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bfd0d91a-f266-44df-835a-76341bd22f90 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/ips" status: 200 len: 149 microversion: 2.1 time: 0.042933 Oct 12 00:26:47.735823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 414/833] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:26:47 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:47.873948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:47.892453 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:47.895089 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:47.896385 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a5c27ba4-6252-465d-8a96-fe95b96ee229 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.187030 Oct 12 00:26:47.900405 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 420/834] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:47 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:26:47.958814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:47.958814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:47.963009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:47.963520 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:47.963951 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:47.964980 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:47.965432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:47.965857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:48.000928 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6c84aab8-34cb-4d0b-a0e7-1ac9870d5376 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050121 Oct 12 00:26:48.001750 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 415/835] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:26:47 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:26:48.121354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:48.123635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:48.129585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:48.130061 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:48.130493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:48.131186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:48.131669 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:48.137099 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:48.161241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-275ca958-0b66-47f1-8ab4-98d006d54e3d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043869 Oct 12 00:26:48.161789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 421/836] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:26:48 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:26:48.229249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:48.229747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:48.235666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:48.236187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:48.236620 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:48.237315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:48.237767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:48.238931 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:48.266309 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:26:48.301791 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:48.690503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-46550729-60b7-4627-921c-6c39759769a6 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 204 len: 0 microversion: 2.1 time: 0.464852 Oct 12 00:26:48.691768 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 416/837] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:26:48 2022] DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:26:48.700042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:48.700650 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:48.706469 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:48.706945 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:48.707393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:48.708086 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:48.708540 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:48.708959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:48.882851 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:48.891259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c35ba52e-435f-4a5f-8278-1f1eeb218db7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1673 microversion: 2.1 time: 0.194904 Oct 12 00:26:48.891860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 422/838] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:48 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:48.924423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:48.925126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:48.928588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:26:48.928738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Wed Oct 12 00:26:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b (ip 10.222.0.36) !!! Oct 12 00:26:48.941543 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:48.942029 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:48.942499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:48.943197 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:48.943718 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:48.944141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:49.119858 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:49.127991 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:49.129530 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:49.130703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0df19809-0c91-49d2-ba2f-814ad0b0b657 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.210681 Oct 12 00:26:49.131259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 417/839] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:48 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:49.463750 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d395ec87-0ffd-4381-89aa-18715b96e267"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:26:49.466159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:49.472259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:49.473382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:49.473818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:49.474509 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:49.474972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:49.475436 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:49.914377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:49.914917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:49.920936 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:49.921562 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:49.921904 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:49.922590 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:49.923038 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:49.923483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:50.053065 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:50.060688 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0706eadb-706c-49f4-9c64-49ac6a1e57d4 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1673 microversion: 2.1 time: 0.150553 Oct 12 00:26:50.061242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 418/840] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:49 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:26:50.158199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:50.158801 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:50.164944 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:50.165364 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:50.165797 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:50.166522 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:50.166972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:50.167410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:50.298302 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:50.307457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:50.309056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:50.310349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8aefcd18-0c72-4fd5-997b-0fd3a1b67dd9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.155987 Oct 12 00:26:50.310981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 419/841] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:50 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:26:51.085285 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:51.086189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:51.092863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:51.093343 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:51.093769 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:51.094467 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:51.094915 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:51.095338 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:51.306233 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:51.314336 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9fd6990d-bd08-4c5c-a2b3-e12d2fe7530b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1673 microversion: 2.1 time: 0.233577 Oct 12 00:26:51.314919 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 420/842] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:51 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1673 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:26:51.336593 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:51.337345 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:51.343344 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:51.343928 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:51.344435 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:51.345188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:51.345711 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:51.346205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:51.540692 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0d8431a2-b0e7-4b6d-bc5d-cb79d935ec01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "POST /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.080769 Oct 12 00:26:51.542357 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 423/843] 10.222.0.36 () {60 vars in 1323 bytes} [Wed Oct 12 00:26:49 2022] POST /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments => generated 194 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:51.586113 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:51.595149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:51.597025 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:51.598278 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0762118a-1544-45d3-8c93-1062dc73d3cf tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1744 microversion: 2.20 time: 0.266167 Oct 12 00:26:51.598835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 421/844] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:51 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1744 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:26:52.339890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:52.342596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:52.350474 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:52.350934 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:52.351331 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:52.352078 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:52.352707 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:52.353130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:52.422449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:52.422696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-1e0352c1-a3a5-4720-a32d-7a385edfe67b req-2bceb884-b65a-4630-82d2-a0e75c74b8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2e624a-ad19-4369-aebf-7af749828d71", "name": "network-vif-deleted", "tag": "68692578-9ba0-4b5a-af9e-cb3c327ca4e7"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:26:52.430441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-007e3bce-7d59-4ff4-8cc1-cd5dfcb88d38 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1605 microversion: 2.1 time: 0.095462 Oct 12 00:26:52.431399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 424/845] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:52 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:52.435414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1e0352c1-a3a5-4720-a32d-7a385edfe67b req-2bceb884-b65a-4630-82d2-a0e75c74b8e1 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:52.435899 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1e0352c1-a3a5-4720-a32d-7a385edfe67b req-2bceb884-b65a-4630-82d2-a0e75c74b8e1 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:52.438886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1e0352c1-a3a5-4720-a32d-7a385edfe67b req-2bceb884-b65a-4630-82d2-a0e75c74b8e1 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:52.461532 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-1e0352c1-a3a5-4720-a32d-7a385edfe67b req-2bceb884-b65a-4630-82d2-a0e75c74b8e1 service nova] Creating event network-vif-deleted:68692578-9ba0-4b5a-af9e-cb3c327ca4e7 for instance ca2e624a-ad19-4369-aebf-7af749828d71 on hv-cinder-84914 Oct 12 00:26:52.470812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-1e0352c1-a3a5-4720-a32d-7a385edfe67b req-2bceb884-b65a-4630-82d2-a0e75c74b8e1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053891 Oct 12 00:26:52.471782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 422/846] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:26:52.632142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:52.633425 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:52.643068 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:52.643646 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:52.644894 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:52.645808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:52.646755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:52.646755 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:52.787344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:52.795976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:52.802616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:52.802616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4bc63e3e-89e8-45cd-8689-bc3bc8709bc2 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1744 microversion: 2.20 time: 0.178048 Oct 12 00:26:52.802616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 425/847] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:52 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:53.460512 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:53.461292 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:53.468089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:53.468569 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:53.469003 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:53.469697 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:53.470148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:53.470571 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:53.504820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:53.505594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:53.506024 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:53.506457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'fault' on Instance uuid ca2e624a-ad19-4369-aebf-7af749828d71 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:26:53.551441 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:53.559072 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-704a6742-0caf-4263-8147-6acc2471725d tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1327 microversion: 2.1 time: 0.103321 Oct 12 00:26:53.559674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 423/848] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:53 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1327 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:53.824372 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:53.824975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:53.831382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:53.831872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:53.832305 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:53.832990 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:53.833437 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:53.833856 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:53.837829 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:26:53.959541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:53.967654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:53.969096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:53.970270 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-91fb10a8-bde6-42ae-ade0-f2c0d5400291 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1744 microversion: 2.20 time: 0.149695 Oct 12 00:26:53.970840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 426/849] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:53 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:54.582040 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:54.582651 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:54.589139 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:54.589616 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:54.590048 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:54.590733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:54.591184 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:54.591637 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:54.622354 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:54.622825 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:54.623257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:54.623744 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'fault' on Instance uuid ca2e624a-ad19-4369-aebf-7af749828d71 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:26:54.663044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:54.670634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e0a7ff93-f046-46fc-aa06-ca265c6ba61b tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1327 microversion: 2.1 time: 0.092538 Oct 12 00:26:54.671197 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 424/850] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:54 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:54.997097 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:54.997809 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:55.004356 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:55.004841 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:55.005280 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:55.006000 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:55.006451 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:55.006872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:55.139905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:55.148908 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:55.150340 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:55.151536 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e041a474-2edb-47d8-bde5-ff673b039e8f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1744 microversion: 2.20 time: 0.158438 Oct 12 00:26:55.152614 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 427/851] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:54 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:55.694222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:55.694827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:55.701205 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:55.701674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:55.702101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:55.702778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:55.703223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:55.703668 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:55.733260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:55.733728 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:55.734154 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:55.734587 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lazy-loading 'fault' on Instance uuid ca2e624a-ad19-4369-aebf-7af749828d71 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:26:55.774751 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bca53aca7b134df1949deb10858f14d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54567f4ea839415a94397e13f93d71cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:55.782397 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7dcbd1f3-e5da-400a-a60b-bbdedf39b4d7 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 200 len: 1327 microversion: 2.1 time: 0.092607 Oct 12 00:26:55.782971 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 425/852] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:55 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 1327 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:26:56.178167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:56.178783 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:56.185510 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:56.185993 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:56.186425 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:56.187123 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:56.187615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:56.188037 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:56.322202 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:56.330395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:56.332383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:56.333537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c7faec52-4333-4f34-b434-451a04ea1ff6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1744 microversion: 2.20 time: 0.160035 Oct 12 00:26:56.334094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 428/853] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:56 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:26:56.807072 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:56.807630 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:56.809792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:26:56.809950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Wed Oct 12 00:26:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 (ip 10.222.0.36) !!! Oct 12 00:26:56.822568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:56.823225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:56.823831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:56.824688 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:56.825139 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:56.825547 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] HTTP exception thrown: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Request method failure captured: Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 HTTP/1.1 Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg2NieFVW2F0W2EvZWOtw1rXn7bYU7eiHdp_meRfZmsxc6TssbeEINQukdIVPGHdfZx8U8DcTo9AkoN-ulZ3U1X8utRwongGTVX6eB-P3R01k0wffpgz9GUVL7JArSor7Ei9477K_XWtVEDnm8DR57ZSyA_raT1sJk-0DZy3TWJVsQ Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:26:56.842835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_54567f4ea839415a94397e13f93d71cc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: bca53aca7b134df1949deb10858f14d0 Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:26:56.845379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'ca2e624a-ad19-4369-aebf-7af749828d71'} Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:26:56.846377 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:26:56.849350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:26:56.851258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Returning 404 to user: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:26:56.851258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-84e2e903-122e-4199-a0bd-c931337bb7f9 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 404 len: 111 microversion: 2.1 time: 0.040904 Oct 12 00:26:56.851258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 426/854] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:26:56 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:26:56.856500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cacae700-8518-41cd-9775-25b58ecdc0d2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '.version_select at 0x7f2fe8cca1f0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:56.925046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cacae700-8518-41cd-9775-25b58ecdc0d2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803206802" status: 202 len: 0 microversion: 2.1 time: 0.072270 Oct 12 00:26:56.926308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 429/855] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Oct 12 00:26:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803206802 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:26:57.361209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:57.362330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:57.369608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:57.370321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:57.372737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:57.372737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:57.372737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:57.372737 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:57.588326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:57.601579 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:57.603204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:57.604656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3aa7a424-61b1-48db-a296-2618aafb3d0c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.247561 Oct 12 00:26:57.605894 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 427/856] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:57 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:58.634144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:58.635353 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:58.642048 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:58.642529 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:58.642963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:58.643695 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:58.644825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:58.645403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:58.797301 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:58.810385 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:58.812382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:58.813579 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8106247c-a80b-497b-b202-ba6be886b04c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.185938 Oct 12 00:26:58.814127 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 430/857] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:58 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:26:59.842141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:26:59.842761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:26:59.850043 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:59.850521 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:59.850953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:59.851699 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:26:59.852175 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:26:59.852642 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:26:59.990723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:26:59.998976 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:00.000442 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:00.001592 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1cd2dff3-1d8c-41b8-9ccd-1c6d81353598 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.163393 Oct 12 00:27:00.002145 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 428/858] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:26:59 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:27:00.539618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-2976efbe-7fc7-4d00-a94d-88130a564a56 req-c902b19d-fc90-45d9-9c76-d296bab47044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facea60e-d753-4eda-b9f7-932b0cf5a63b", "name": "network-vif-plugged", "status": "completed", "tag": "ff37e4cb-00cf-4bd1-b77a-3dffa69e456e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:00.559429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2976efbe-7fc7-4d00-a94d-88130a564a56 req-c902b19d-fc90-45d9-9c76-d296bab47044 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:00.560104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2976efbe-7fc7-4d00-a94d-88130a564a56 req-c902b19d-fc90-45d9-9c76-d296bab47044 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:00.560726 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2976efbe-7fc7-4d00-a94d-88130a564a56 req-c902b19d-fc90-45d9-9c76-d296bab47044 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:00.576448 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-2976efbe-7fc7-4d00-a94d-88130a564a56 req-c902b19d-fc90-45d9-9c76-d296bab47044 service nova] Creating event network-vif-plugged:ff37e4cb-00cf-4bd1-b77a-3dffa69e456e for instance facea60e-d753-4eda-b9f7-932b0cf5a63b on hv-cinder-84914 Oct 12 00:27:00.582022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-2976efbe-7fc7-4d00-a94d-88130a564a56 req-c902b19d-fc90-45d9-9c76-d296bab47044 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047294 Oct 12 00:27:00.583162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 431/859] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:01.033932 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:01.035236 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:01.042189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:01.042666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:01.043259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:01.044146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:01.045260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:01.046502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:01.231664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:01.233834 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:01.235580 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:01.237094 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9782156b-8253-498e-9142-e11e517f8376 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.212106 Oct 12 00:27:01.239408 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 429/860] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:01 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:02.268057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:02.271527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:02.279393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.280004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.280942 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.282182 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.282880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.283415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.449065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:02.457227 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:02.458689 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:02.459903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-52499c71-1dd1-4ab0-9bb6-297dd69d8ac8 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.198559 Oct 12 00:27:02.460463 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 432/861] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:02 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:02.510018 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:02.510701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:02.513488 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:02.518811 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.519850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.520735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.521446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.521901 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.522327 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.607026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:02.607566 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:02.614854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.615585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.616510 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.617415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.618058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.618668 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.634039 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'services' on Instance uuid 731e899f-66f8-474a-9ebb-adc979dbeb13 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:27:02.646821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] HTTP exception thrown: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Request method failure captured: Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 HTTP/1.1 Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg2NieFVW2F0W2EvZWOtw1rXn7bYU7eiHdp_meRfZmsxc6TssbeEINQukdIVPGHdfZx8U8DcTo9AkoN-ulZ3U1X8utRwongGTVX6eB-P3R01k0wffpgz9GUVL7JArSor7Ei9477K_XWtVEDnm8DR57ZSyA_raT1sJk-0DZy3TWJVsQ Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:27:02.648843 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_54567f4ea839415a94397e13f93d71cc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: bca53aca7b134df1949deb10858f14d0 Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.653366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'ca2e624a-ad19-4369-aebf-7af749828d71'} Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:02.654087 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.655332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.656966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Returning 404 to user: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:02.656966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4322ff1a-a411-4af3-922e-62cbb1d273a2 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 404 len: 111 microversion: 2.1 time: 0.047579 Oct 12 00:27:02.656966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 433/862] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:27:02 2022] DELETE /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:02.663047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:02.664303 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: ca2e624a-ad19-4369-aebf-7af749828d71] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:02.671474 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.672249 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.672879 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.673756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.674363 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.675094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.689333 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] HTTP exception thrown: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Request method failure captured: Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 HTTP/1.1 Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg2NieFVW2F0W2EvZWOtw1rXn7bYU7eiHdp_meRfZmsxc6TssbeEINQukdIVPGHdfZx8U8DcTo9AkoN-ulZ3U1X8utRwongGTVX6eB-P3R01k0wffpgz9GUVL7JArSor7Ei9477K_XWtVEDnm8DR57ZSyA_raT1sJk-0DZy3TWJVsQ Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:27:02.691709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_54567f4ea839415a94397e13f93d71cc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: bca53aca7b134df1949deb10858f14d0 Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.693230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'ca2e624a-ad19-4369-aebf-7af749828d71'} Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:02.694144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. Oct 12 00:27:02.695297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:02.697698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Returning 404 to user: Instance ca2e624a-ad19-4369-aebf-7af749828d71 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:02.698744 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4d7982af-6f0f-467a-9393-702d30f34d1e tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71" status: 404 len: 111 microversion: 2.1 time: 0.043233 Oct 12 00:27:02.702713 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 434/863] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:02 2022] GET /compute/v2.1/servers/ca2e624a-ad19-4369-aebf-7af749828d71 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 00:27:02.850653 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bf0a0514-c590-4a42-9ed8-a93555cac790 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments/d395ec87-0ffd-4381-89aa-18715b96e267" status: 202 len: 0 microversion: 2.1 time: 0.345025 Oct 12 00:27:02.854416 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 430/864] 10.222.0.36 () {58 vars in 1416 bytes} [Wed Oct 12 00:27:02 2022] DELETE /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments/d395ec87-0ffd-4381-89aa-18715b96e267 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:27:02.860544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:02.862728 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:02.868711 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.869196 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.869630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.870531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:02.871226 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:02.871687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:02.906818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-83a41203-a5b2-4905-97c8-4044c8cb2718 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050587 Oct 12 00:27:02.907428 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 435/865] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:27:02 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:03.485796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:03.486486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:03.493299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:03.493772 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:03.494200 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:03.494885 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:03.495328 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:03.495773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:03.625670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:03.633968 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:03.635457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:03.636626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e63881bf-f7fa-42ac-a67b-1a58c0abada4 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.155241 Oct 12 00:27:03.637184 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 431/866] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:03 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:03.920798 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:03.923449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:03.930774 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:03.931538 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:03.932154 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:03.933040 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:03.933495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:03.933920 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:03.967277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d86b634a-4e26-4993-8edb-eab979c4a730 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050461 Oct 12 00:27:03.968144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 436/867] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:27:03 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:04.662718 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:04.663433 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:04.669703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:04.670405 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:04.670844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:04.673519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:04.674315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:04.676145 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:04.698490 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:04.827516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:04.841830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:04.843460 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:04.862966 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-da52c073-5e5a-4583-bd03-8464624e362e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.186038 Oct 12 00:27:04.862966 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 432/868] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:04 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:27:04.980659 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:04.983004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:04.989567 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:04.990258 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:04.990685 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:04.991427 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:04.992112 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:04.992757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:05.026975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-836add12-6ff4-496b-9af9-0100c34b640e tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050068 Oct 12 00:27:05.027472 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 437/869] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:27:04 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:05.871098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:05.871864 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:05.880518 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:05.881327 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:05.881827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:05.882789 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:05.883305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:05.883814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:06.040011 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:06.042829 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:06.050839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:06.051326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:06.051824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:06.052660 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:06.053114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:06.054314 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:06.100471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-40c10eb8-d405-4ee4-b2e7-0295586378fb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064226 Oct 12 00:27:06.100980 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 438/870] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:27:06 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:27:06.113099 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:06.123967 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:06.125786 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:06.127293 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5866cfc6-b733-4359-a27b-a21cf844e30c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.260556 Oct 12 00:27:06.134425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 433/871] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:05 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:06.199965 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:06.200889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:06.211789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:06.215456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:06.215456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:06.215456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:06.215456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:06.215810 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:06.232647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] HTTP exception thrown: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Request method failure captured: Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 HTTP/1.1 Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg2NieFVW2F0W2EvZWOtw1rXn7bYU7eiHdp_meRfZmsxc6TssbeEINQukdIVPGHdfZx8U8DcTo9AkoN-ulZ3U1X8utRwongGTVX6eB-P3R01k0wffpgz9GUVL7JArSor7Ei9477K_XWtVEDnm8DR57ZSyA_raT1sJk-0DZy3TWJVsQ Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:27:06.234324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_54567f4ea839415a94397e13f93d71cc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: bca53aca7b134df1949deb10858f14d0 Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.236102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '1a130e92-2fae-45a7-a64c-bffbf46b4758'} Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:06.236886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.238283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.242198 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Returning 404 to user: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:06.243330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bcae332b-39e0-4333-9893-74440d027394 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 404 len: 111 microversion: 2.1 time: 0.047379 Oct 12 00:27:06.248543 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 439/872] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:27:06 2022] DELETE /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:06.257235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:06.258090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] [instance: 1a130e92-2fae-45a7-a64c-bffbf46b4758] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:06.264934 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:06.265807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:06.266567 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:06.267352 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:06.268066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:06.268583 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:06.284259 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] HTTP exception thrown: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Request method failure captured: Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 HTTP/1.1 Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg2NieFVW2F0W2EvZWOtw1rXn7bYU7eiHdp_meRfZmsxc6TssbeEINQukdIVPGHdfZx8U8DcTo9AkoN-ulZ3U1X8utRwongGTVX6eB-P3R01k0wffpgz9GUVL7JArSor7Ei9477K_XWtVEDnm8DR57ZSyA_raT1sJk-0DZy3TWJVsQ Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:06.286497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_54567f4ea839415a94397e13f93d71cc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/54567f4ea839415a94397e13f93d71cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 54567f4ea839415a94397e13f93d71cc Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeTestJSON-76609124 Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: bca53aca7b134df1949deb10858f14d0 Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeTestJSON-76609124-project Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.288446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '1a130e92-2fae-45a7-a64c-bffbf46b4758'} Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:06.289169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. Oct 12 00:27:06.290372 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:06.291499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] Returning 404 to user: Instance 1a130e92-2fae-45a7-a64c-bffbf46b4758 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:06.291499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bfb04eac-c855-4ce4-8f25-780ec771c766 tempest-AttachVolumeTestJSON-76609124 tempest-AttachVolumeTestJSON-76609124-project] 10.222.0.36 "GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758" status: 404 len: 111 microversion: 2.1 time: 0.034953 Oct 12 00:27:06.291499 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 434/873] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:06 2022] GET /compute/v2.1/servers/1a130e92-2fae-45a7-a64c-bffbf46b4758 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:07.113308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:07.115930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:07.123419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:07.125917 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:07.126721 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:07.127163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:07.127919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:07.128952 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:07.129611 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:07.157731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:07.158969 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:07.172747 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:07.175921 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:07.176684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:07.177684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:07.178305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:07.178918 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:07.189523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8c72b61e-b665-4101-b598-00450f1a7fea tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076849 Oct 12 00:27:07.202552 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 440/874] 10.222.0.36 () {58 vars in 1302 bytes} [Wed Oct 12 00:27:07 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 00:27:07.285157 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:07.285938 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:07.293244 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:07.294024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:07.294663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:07.295647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:07.296172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:07.296604 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:07.325716 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:27:07.445102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:07.455136 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:07.456819 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:07.459088 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-625a8527-4edc-41b8-bbea-9d39e8c4d92d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.304627 Oct 12 00:27:07.461643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 435/875] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:07 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:07.733354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f0292d2e-5d06-40d3-8a91-f573e45fce67 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 204 len: 0 microversion: 2.1 time: 0.452264 Oct 12 00:27:07.734055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 441/876] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:27:07 2022] DELETE /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 00:27:07.750414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:07.750414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:07.750414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:07.750866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:07.751222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:07.751981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:07.752434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:07.752859 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:07.958288 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:07.970271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bc78f628-e82e-445e-8bf6-a2a1efea0cad tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1679 microversion: 2.1 time: 0.230964 Oct 12 00:27:07.974062 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 436/877] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:07 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:27:08.489623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:08.490403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:08.500492 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:08.500982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:08.501412 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:08.502186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:08.502740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:08.503110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:08.680732 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:08.691881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:08.698116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:08.699442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6502e66c-3d7e-457e-88e3-081a49e07f7d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.214811 Oct 12 00:27:08.700005 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 442/878] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:08 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:27:08.994243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:08.994856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:09.001534 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:09.002213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:09.002837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:09.003608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:09.004232 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:09.004658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:09.199856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:09.207964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bcd87492-5164-4d66-bdfc-0be3609244bb tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1679 microversion: 2.1 time: 0.217573 Oct 12 00:27:09.208525 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 437/879] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:08 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:27:09.730880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:09.730880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:09.734402 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:09.734881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:09.735307 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:09.736038 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:09.736483 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:09.736899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:09.882448 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:09.890708 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:09.892477 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:09.893727 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f74e3921-7b65-4ca6-9efc-cfd2358d1992 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1739 microversion: 2.20 time: 0.172801 Oct 12 00:27:09.894320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 443/880] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:09 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:10.232886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:10.233700 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:10.247762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:10.247762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:10.247762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:10.247762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:10.248146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:10.248146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:10.580121 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:10.591233 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-042de9e9-ecfd-4e95-b748-799d3fb1a8a9 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1679 microversion: 2.1 time: 0.362803 Oct 12 00:27:10.592458 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 438/881] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:10 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1679 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:27:10.923597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:10.923597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:10.928737 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:10.929420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:10.929854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:10.930589 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:10.931047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:10.931504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:11.065488 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:11.070281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:11.075404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:11.076853 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:11.078017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-72f2a96f-5472-40ed-8c4c-97dd8b8c6e9e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1721 microversion: 2.20 time: 0.162070 Oct 12 00:27:11.078884 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 444/882] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:10 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:11.616260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:11.617545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:11.626739 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:11.627296 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:11.627957 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:11.628923 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:11.634149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:11.634149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:11.647847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-e0cca2e8-cb3f-40f3-8c9a-a02f2a4b2c42 req-03b59f01-6d96-430a-b7a0-1bd67ba83e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731e899f-66f8-474a-9ebb-adc979dbeb13", "name": "network-vif-deleted", "tag": "ae56abca-71b5-4952-be55-bff130c4bc5e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:11.662659 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e0cca2e8-cb3f-40f3-8c9a-a02f2a4b2c42 req-03b59f01-6d96-430a-b7a0-1bd67ba83e74 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:11.666081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e0cca2e8-cb3f-40f3-8c9a-a02f2a4b2c42 req-03b59f01-6d96-430a-b7a0-1bd67ba83e74 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:11.666081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e0cca2e8-cb3f-40f3-8c9a-a02f2a4b2c42 req-03b59f01-6d96-430a-b7a0-1bd67ba83e74 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:11.700639 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-e0cca2e8-cb3f-40f3-8c9a-a02f2a4b2c42 req-03b59f01-6d96-430a-b7a0-1bd67ba83e74 service nova] Creating event network-vif-deleted:ae56abca-71b5-4952-be55-bff130c4bc5e for instance 731e899f-66f8-474a-9ebb-adc979dbeb13 on hv-cinder-84914 Oct 12 00:27:11.706562 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-e0cca2e8-cb3f-40f3-8c9a-a02f2a4b2c42 req-03b59f01-6d96-430a-b7a0-1bd67ba83e74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062662 Oct 12 00:27:11.710189 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 445/883] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:27:11.735847 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:11.747815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-fa6593e8-4f96-4ef0-a090-ab606e5b536b tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1612 microversion: 2.1 time: 0.135818 Oct 12 00:27:11.749571 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 439/884] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:11 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1612 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:27:12.112502 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:12.113232 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:12.123404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:12.124115 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:12.124554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:12.125252 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:12.125871 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:12.126452 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:12.264812 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:12.274893 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:12.276443 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:12.278035 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fcc24895-c801-4374-bde0-b854c074f513 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1721 microversion: 2.20 time: 0.170148 Oct 12 00:27:12.278593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 446/885] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:12 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:12.775606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:12.777781 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:12.784955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:12.785637 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:12.786343 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:12.787543 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:12.788241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:12.788868 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:12.857635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-aaa493bb-4371-4fc7-ab11-dbe6c6e220d7 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Action: 'create', calling method: .version_select at 0x7f2fe8c94160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1114917825"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:12.861292 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:12.870155 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-eee3afbd-9a3c-430b-a616-60827bb0e241 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1612 microversion: 2.1 time: 0.101289 Oct 12 00:27:12.871028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 447/886] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:12 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1612 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:27:13.305077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:13.305895 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:13.323903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:13.324407 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:13.324880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:13.325670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:13.326148 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:13.326584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:13.523771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:13.532949 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:13.534366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:13.536155 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-84cc1bf9-53bb-456c-bc30-9d0ea74bddff tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1721 microversion: 2.20 time: 0.235890 Oct 12 00:27:13.536880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 448/887] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:13 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:27:13.630731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-aaa493bb-4371-4fc7-ab11-dbe6c6e220d7 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.941786 Oct 12 00:27:13.631470 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 440/888] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Oct 12 00:27:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 943 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 00:27:13.646857 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0beb3362-ffc3-460b-9e42-8ab390286578 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8c989d0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:13.705719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0beb3362-ffc3-460b-9e42-8ab390286578 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510" status: 200 len: 345 microversion: 2.1 time: 0.064492 Oct 12 00:27:13.707670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 449/889] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:13 2022] GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:13.898692 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:13.899433 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:13.905997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:13.906478 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:13.906923 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:13.907639 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:13.908085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:13.908501 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:13.940483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:13.941480 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:13.941903 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:13.942341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lazy-loading 'fault' on Instance uuid 731e899f-66f8-474a-9ebb-adc979dbeb13 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:27:13.986380 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de766cb582ba4c18b1fda9bf4ad43f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10160596b45c49249155b0c2585e70bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:13.994346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-dcb89f8e-c27d-4f51-a49c-9c289a2aa246 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 200 len: 1330 microversion: 2.1 time: 0.104335 Oct 12 00:27:13.994919 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 441/890] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:13 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:27:14.566480 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:14.567672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:14.574458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:14.574799 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-0980c35f-083c-4ca0-b538-d59ae227d293 req-331d2bc7-d063-4c85-a6f9-07a2edd39ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facea60e-d753-4eda-b9f7-932b0cf5a63b", "name": "network-vif-unplugged", "status": "completed", "tag": "ff37e4cb-00cf-4bd1-b77a-3dffa69e456e"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:14.575395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:14.582479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:14.582479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:14.582479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:14.593404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:14.606978 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-0980c35f-083c-4ca0-b538-d59ae227d293 req-331d2bc7-d063-4c85-a6f9-07a2edd39ba0 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:14.611394 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-0980c35f-083c-4ca0-b538-d59ae227d293 req-331d2bc7-d063-4c85-a6f9-07a2edd39ba0 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:14.611394 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-0980c35f-083c-4ca0-b538-d59ae227d293 req-331d2bc7-d063-4c85-a6f9-07a2edd39ba0 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:14.622362 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-0980c35f-083c-4ca0-b538-d59ae227d293 req-331d2bc7-d063-4c85-a6f9-07a2edd39ba0 service nova] Creating event network-vif-unplugged:ff37e4cb-00cf-4bd1-b77a-3dffa69e456e for instance facea60e-d753-4eda-b9f7-932b0cf5a63b on hv-cinder-84914 Oct 12 00:27:14.627796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-0980c35f-083c-4ca0-b538-d59ae227d293 req-331d2bc7-d063-4c85-a6f9-07a2edd39ba0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057414 Oct 12 00:27:14.628945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 442/891] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:14.722404 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-4a61dd8f-3056-42cc-b68d-956ff483ce11 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8c94040>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:14.733914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:14.742982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:14.744452 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:14.745821 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6a86bea6-f0cf-4eca-8832-bf76ab1ce10b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1724 microversion: 2.20 time: 0.184536 Oct 12 00:27:14.746380 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 450/892] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:14 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:14.771198 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-4a61dd8f-3056-42cc-b68d-956ff483ce11 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510" status: 200 len: 346 microversion: 2.1 time: 0.053409 Oct 12 00:27:14.771338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4a868a8-42d5-4455-926f-9a1f40a21ede"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:14.771919 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 443/893] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:14 2022] GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:14.773768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:14.780198 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:14.780675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:14.783618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:14.783618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:14.783618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:14.783618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:14.785534 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a612b22c-277e-42be-aeb0-d61ad48f171e tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Action: 'create', calling method: .version_select at 0x7f2fe8cef820>, body: {"snapshot": {"volume_id": "898a3acc-23e5-4fdf-892c-ef0e51a78510", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1713778980"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:15.251684 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a612b22c-277e-42be-aeb0-d61ad48f171e tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.470613 Oct 12 00:27:15.252479 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 444/894] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Oct 12 00:27:14 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:15.257135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:15.258249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:15.264852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:15.265339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:15.265770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:15.266721 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:15.267173 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:15.267679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:15.281220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 HTTP/1.1 Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:15.282873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:15.284498 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '731e899f-66f8-474a-9ebb-adc979dbeb13'} Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:15.285963 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:15.287961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:15.295603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:15.295603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7a01af0c-3948-4b57-b848-d594979a6a26 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 404 len: 111 microversion: 2.1 time: 0.030648 Oct 12 00:27:15.295603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 445/895] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:15 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:15.295603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0059b78c-7ae0-4a8f-ae9d-ff0794de22bd tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8d481f0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:15.319967 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0059b78c-7ae0-4a8f-ae9d-ff0794de22bd tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865" status: 200 len: 287 microversion: 2.1 time: 0.033580 Oct 12 00:27:15.320668 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 446/896] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Oct 12 00:27:15 2022] GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:15.326073 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bfd99df9-f07f-4ee8-934c-4660ba9e50d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '.version_select at 0x7f2fe8ca4430>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:15.395286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bfd99df9-f07f-4ee8-934c-4660ba9e50d1 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376320981" status: 202 len: 0 microversion: 2.1 time: 0.072715 Oct 12 00:27:15.395936 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 447/897] 10.222.0.36 () {58 vars in 1218 bytes} [Wed Oct 12 00:27:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376320981 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:27:15.400594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6ca26761-441f-45dc-bb5f-72c5e6325056 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8ca4790>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:15.431784 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6ca26761-441f-45dc-bb5f-72c5e6325056 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034755 Oct 12 00:27:15.432351 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 448/898] 10.222.0.36 () {58 vars in 1140 bytes} [Wed Oct 12 00:27:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:15.443923 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-72e5fa40-24a1-4379-8b9e-6816070c7858 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8c94040>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:15.475058 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-72e5fa40-24a1-4379-8b9e-6816070c7858 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865" status: 200 len: 287 microversion: 2.1 time: 0.035415 Oct 12 00:27:15.480242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 449/899] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Oct 12 00:27:15 2022] GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:27:15.746289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-57a00b5d-f74b-445d-9205-d73dc55f020b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.978890 Oct 12 00:27:15.753961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 451/900] 10.222.0.36 () {62 vars in 1364 bytes} [Wed Oct 12 00:27:14 2022] POST /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/os-volume_attachments => generated 188 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 00:27:15.885350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:15.885888 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:15.892964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:15.899321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:15.899321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:15.899321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:15.899321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:15.899816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:16.488496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4c811038-b85a-4c73-bdc2-57c77a9ef5b6 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8cba0d0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:16.533734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4c811038-b85a-4c73-bdc2-57c77a9ef5b6 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865" status: 200 len: 287 microversion: 2.1 time: 0.049710 Oct 12 00:27:16.534425 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 452/901] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Oct 12 00:27:16 2022] GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:17.549919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4454dedb-7ba8-4080-acb5-b4a9873a15d1 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8c98700>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:17.618883 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4454dedb-7ba8-4080-acb5-b4a9873a15d1 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865" status: 200 len: 287 microversion: 2.1 time: 0.073934 Oct 12 00:27:17.618883 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 453/902] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Oct 12 00:27:17 2022] GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:18.557360 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-afc78761-6a1c-4a64-aa06-ac6c850b14f6 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "DELETE /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/os-volume_attachments/c4a868a8-42d5-4455-926f-9a1f40a21ede" status: 202 len: 0 microversion: 2.20 time: 2.676050 Oct 12 00:27:18.559132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 450/903] 10.222.0.36 () {60 vars in 1457 bytes} [Wed Oct 12 00:27:15 2022] DELETE /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/os-volume_attachments/c4a868a8-42d5-4455-926f-9a1f40a21ede => generated 0 bytes in 2679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:27:18.636474 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:18.637446 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-29507297-aff1-443c-ae39-f70ec80ee43d tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8ce40d0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:18.643335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:18.695570 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-29507297-aff1-443c-ae39-f70ec80ee43d tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865" status: 200 len: 288 microversion: 2.1 time: 0.069274 Oct 12 00:27:18.697090 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 454/904] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Oct 12 00:27:18 2022] GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 => generated 288 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:18.709995 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c4957213-26e4-4872-a5bf-a4c26cf69600 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8cba5e0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:18.813771 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:18.814299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:18.814727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:18.815468 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:18.815969 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:18.816399 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:18.862011 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c4957213-26e4-4872-a5bf-a4c26cf69600 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865" status: 202 len: 0 microversion: 2.1 time: 0.156236 Oct 12 00:27:18.862605 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 455/905] 10.222.0.36 () {58 vars in 1254 bytes} [Wed Oct 12 00:27:18 2022] DELETE /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 00:27:18.872885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9517aa76-cb0e-4a1b-bd6c-f519581442c2 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8cca5e0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:18.924576 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9517aa76-cb0e-4a1b-bd6c-f519581442c2 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865" status: 200 len: 287 microversion: 2.1 time: 0.057589 Oct 12 00:27:18.925922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 456/906] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Oct 12 00:27:18 2022] GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:18.933291 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125809) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 00:27:19.247813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a5be4417-3367-4c22-b7a1-64adbb36fe9f tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "POST /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/action" status: 202 len: 0 microversion: 2.20 time: 0.617057 Oct 12 00:27:19.248061 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 451/907] 10.222.0.36 () {62 vars in 1319 bytes} [Wed Oct 12 00:27:18 2022] POST /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:27:19.258854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:19.264079 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:19.275240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:19.275751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:19.276182 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:19.276938 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:19.277385 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:19.277801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:19.495204 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:19.505815 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:19.507827 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:19.509012 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c00e94ae-ae3a-41c3-9ae8-8dd8c884af3e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1672 microversion: 2.20 time: 0.256426 Oct 12 00:27:19.509770 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 457/908] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:19 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1672 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:19.726574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:19.727074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:19.738462 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:19.738970 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:19.739423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:19.740683 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:19.742423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:19.744041 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:19.767187 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 HTTP/1.1 Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:19.769550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.770975 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '731e899f-66f8-474a-9ebb-adc979dbeb13'} Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:19.771727 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.772860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.778413 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:19.779616 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-186a52fe-fb77-496f-8bb4-4838a1352f01 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 404 len: 111 microversion: 2.1 time: 0.057808 Oct 12 00:27:19.781693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 452/909] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:27:19 2022] DELETE /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:19.799871 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:19.800668 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 731e899f-66f8-474a-9ebb-adc979dbeb13] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:19.810041 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:19.810541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:19.810976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:19.812383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:19.812853 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:19.813281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:19.832254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 HTTP/1.1 Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:27:19.833914 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.835609 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '731e899f-66f8-474a-9ebb-adc979dbeb13'} Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:19.836961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. Oct 12 00:27:19.838409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.841094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 731e899f-66f8-474a-9ebb-adc979dbeb13 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:19.842123 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-05d50212-f5f3-4858-ad12-e6555b73e934 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13" status: 404 len: 111 microversion: 2.1 time: 0.051202 Oct 12 00:27:19.843429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 458/910] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:19 2022] GET /compute/v2.1/servers/731e899f-66f8-474a-9ebb-adc979dbeb13 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:19.944084 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-76534ae5-e881-4c79-b7a3-654a55d30012 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8d341f0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:19.975079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-76534ae5-e881-4c79-b7a3-654a55d30012 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] HTTP exception thrown: Snapshot 3fac8443-b511-4ed1-9e01-113074d94865 could not be found. Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-76534ae5-e881-4c79-b7a3-654a55d30012 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Request method failure captured: Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 HTTP/1.1 Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgngIOjHUykWhYaf_TubtuQYTJAiBGXBW_khTuGONViDUNl7XUiCSfe84Z1x_u0kzw2o-GcZNtzsZ3L72iALIXbkpWKId0nBm8UWXwLUy90Q0VN7b5fG5MSOOI-FTqBKRr0cEQYrF1wviQKltu-L-lSej8_Gx1TwoqpqYGFh13sel6o Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 85a220a727d24cb48b8902f6787479a5 Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:19.977875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85a220a727d24cb48b8902f6787479a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 85a220a727d24cb48b8902f6787479a5 Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-VolumesSnapshotsTestJSON-725267216-project Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: d81c6833a09244229484527eb694fca8 Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725267216-project Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Snapshot 3fac8443-b511-4ed1-9e01-113074d94865 could not be found. Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '3fac8443-b511-4ed1-9e01-113074d94865'} Oct 12 00:27:19.979262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3fac8443-b511-4ed1-9e01-113074d94865 could not be found. (HTTP 404) (Request-ID: req-2c637313-bf9c-445f-ade0-02103a2129df) Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.980128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:27:19.981451 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3fac8443-b511-4ed1-9e01-113074d94865 could not be found. Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 12 00:27:19.982861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3fac8443-b511-4ed1-9e01-113074d94865 could not be found. Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3fac8443-b511-4ed1-9e01-113074d94865 could not be found. Oct 12 00:27:19.984390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:19.990135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-76534ae5-e881-4c79-b7a3-654a55d30012 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Returning 404 to user: Snapshot 3fac8443-b511-4ed1-9e01-113074d94865 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:19.992147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-76534ae5-e881-4c79-b7a3-654a55d30012 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865" status: 404 len: 111 microversion: 2.1 time: 0.053272 Oct 12 00:27:20.004207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b617caa5-d69b-416a-aa41-487d10814a0c tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8c56d30>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:20.009708 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 453/911] 10.222.0.36 () {58 vars in 1251 bytes} [Wed Oct 12 00:27:19 2022] GET /compute/v2.1/os-snapshots/3fac8443-b511-4ed1-9e01-113074d94865 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:20.259890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b617caa5-d69b-416a-aa41-487d10814a0c tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510" status: 202 len: 0 microversion: 2.1 time: 0.258249 Oct 12 00:27:20.261797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 459/912] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:27:19 2022] DELETE /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:27:20.270411 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0b6de4d5-b4b2-417e-8885-b0cba492df1b tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8cd48b0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:20.356422 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0b6de4d5-b4b2-417e-8885-b0cba492df1b tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510" status: 200 len: 345 microversion: 2.1 time: 0.092970 Oct 12 00:27:20.357181 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 454/913] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:20 2022] GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 => generated 345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:27:20.536621 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:20.537612 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:20.545106 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:20.545629 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:20.550081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:20.550081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:20.550081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:20.550081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:20.697029 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:20.705416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:20.707505 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:20.708859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-79ffb8dd-4685-4a6f-95bf-8a5933cb0b57 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1672 microversion: 2.20 time: 0.176884 Oct 12 00:27:20.709585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 460/914] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:20 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:21.249582 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:21.250211 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:21.256961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.257776 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.258441 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.259586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.260275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.260894 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.277960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 HTTP/1.1 Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:21.280151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.281437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '7e994443-5484-48d9-9a1b-e9662eb497e2'} Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:21.282137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.283299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.286078 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:21.287163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7f8d609d-c4f1-4f0e-9e0b-0c1068f0331d tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 404 len: 111 microversion: 2.1 time: 0.042560 Oct 12 00:27:21.287953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 455/915] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:27:21 2022] DELETE /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:21.297388 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:21.298107 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 7e994443-5484-48d9-9a1b-e9662eb497e2] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:21.308553 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.309307 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.309747 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.310455 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.311036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.311512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.326501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 HTTP/1.1 Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:27:21.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.329533 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '7e994443-5484-48d9-9a1b-e9662eb497e2'} Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:21.330261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. Oct 12 00:27:21.332267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.333342 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 7e994443-5484-48d9-9a1b-e9662eb497e2 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:21.333342 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a546d643-e550-4511-8d87-861a8386e71c tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2" status: 404 len: 111 microversion: 2.1 time: 0.037094 Oct 12 00:27:21.333342 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 461/916] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:21 2022] GET /compute/v2.1/servers/7e994443-5484-48d9-9a1b-e9662eb497e2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:21.338462 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:21.341599 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:21.346200 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.347494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.348158 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.349330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.349985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.350631 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.372699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-deb0ea53-7a40-44c0-99ce-6c1b5471d278 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8c98670>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:21.377144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b HTTP/1.1 Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:21.382787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.384213 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '69a75274-767b-4dd6-86bc-536d9a96b07b'} Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:21.384914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.386090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.388195 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:21.389024 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3d989c34-6885-4879-b582-600ac0694e81 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 404 len: 111 microversion: 2.1 time: 0.054433 Oct 12 00:27:21.389618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 456/917] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:27:21 2022] DELETE /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:21.398652 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:21.400455 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 69a75274-767b-4dd6-86bc-536d9a96b07b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:21.405385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.405541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-deb0ea53-7a40-44c0-99ce-6c1b5471d278 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] HTTP exception thrown: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.405875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.406308 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.407052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-deb0ea53-7a40-44c0-99ce-6c1b5471d278 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Request method failure captured: Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 HTTP/1.1 Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgngIOjHUykWhYaf_TubtuQYTJAiBGXBW_khTuGONViDUNl7XUiCSfe84Z1x_u0kzw2o-GcZNtzsZ3L72iALIXbkpWKId0nBm8UWXwLUy90Q0VN7b5fG5MSOOI-FTqBKRr0cEQYrF1wviQKltu-L-lSej8_Gx1TwoqpqYGFh13sel6o Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 85a220a727d24cb48b8902f6787479a5 Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:27:21.407449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85a220a727d24cb48b8902f6787479a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 85a220a727d24cb48b8902f6787479a5 Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesSnapshotsTestJSON-725267216-project Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: d81c6833a09244229484527eb694fca8 Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725267216-project Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '898a3acc-23e5-4fdf-892c-ef0e51a78510'} Oct 12 00:27:21.408720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. (HTTP 404) (Request-ID: req-081be308-f770-4428-b6c6-9fab9b3ecc2c) Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.410062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:27:21.411213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 00:27:21.412344 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.413447 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.414090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.414090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.414228 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-deb0ea53-7a40-44c0-99ce-6c1b5471d278 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Returning 404 to user: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:21.414228 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-deb0ea53-7a40-44c0-99ce-6c1b5471d278 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510" status: 404 len: 109 microversion: 2.1 time: 0.042241 Oct 12 00:27:21.414228 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 462/918] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:21 2022] GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 00:27:21.420501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-245ffa29-500c-41b6-8f3e-69cc412c705a tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8c98430>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:21.428148 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b HTTP/1.1 Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:21.432141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.433717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '69a75274-767b-4dd6-86bc-536d9a96b07b'} Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:21.434437 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. Oct 12 00:27:21.435860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.437131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 69a75274-767b-4dd6-86bc-536d9a96b07b could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:21.437131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-99969254-a15a-4420-9918-d07a9e980071 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b" status: 404 len: 111 microversion: 2.1 time: 0.036179 Oct 12 00:27:21.437131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 457/919] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:21 2022] GET /compute/v2.1/servers/69a75274-767b-4dd6-86bc-536d9a96b07b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 00:27:21.455880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-245ffa29-500c-41b6-8f3e-69cc412c705a tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] HTTP exception thrown: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-245ffa29-500c-41b6-8f3e-69cc412c705a tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Request method failure captured: Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 HTTP/1.1 Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgngIOjHUykWhYaf_TubtuQYTJAiBGXBW_khTuGONViDUNl7XUiCSfe84Z1x_u0kzw2o-GcZNtzsZ3L72iALIXbkpWKId0nBm8UWXwLUy90Q0VN7b5fG5MSOOI-FTqBKRr0cEQYrF1wviQKltu-L-lSej8_Gx1TwoqpqYGFh13sel6o Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 85a220a727d24cb48b8902f6787479a5 Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:27:21.457905 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85a220a727d24cb48b8902f6787479a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 85a220a727d24cb48b8902f6787479a5 Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesSnapshotsTestJSON-725267216-project Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: d81c6833a09244229484527eb694fca8 Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725267216-project Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '898a3acc-23e5-4fdf-892c-ef0e51a78510'} Oct 12 00:27:21.459253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. (HTTP 404) (Request-ID: req-344f6a8a-3d3f-41df-baf7-137b9255439c) Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.460259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 00:27:21.461418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 00:27:21.462511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-245ffa29-500c-41b6-8f3e-69cc412c705a tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Returning 404 to user: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-245ffa29-500c-41b6-8f3e-69cc412c705a tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510" status: 404 len: 109 microversion: 2.1 time: 0.043055 Oct 12 00:27:21.465406 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 463/920] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:27:21 2022] DELETE /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:21.469218 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1f41de3e-174a-4caf-8bed-c24c0d19bf26 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Calling method '.version_select at 0x7f2fe8d341f0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:21.500675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-1f41de3e-174a-4caf-8bed-c24c0d19bf26 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] HTTP exception thrown: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1f41de3e-174a-4caf-8bed-c24c0d19bf26 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Request method failure captured: Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 HTTP/1.1 Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgngIOjHUykWhYaf_TubtuQYTJAiBGXBW_khTuGONViDUNl7XUiCSfe84Z1x_u0kzw2o-GcZNtzsZ3L72iALIXbkpWKId0nBm8UWXwLUy90Q0VN7b5fG5MSOOI-FTqBKRr0cEQYrF1wviQKltu-L-lSej8_Gx1TwoqpqYGFh13sel6o Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 85a220a727d24cb48b8902f6787479a5 Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:21.503432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_85a220a727d24cb48b8902f6787479a5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/85a220a727d24cb48b8902f6787479a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 85a220a727d24cb48b8902f6787479a5 Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725267216 Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-VolumesSnapshotsTestJSON-725267216-project Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: d81c6833a09244229484527eb694fca8 Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725267216-project Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '898a3acc-23e5-4fdf-892c-ef0e51a78510'} Oct 12 00:27:21.505185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. (HTTP 404) (Request-ID: req-7ac15c5d-1459-4617-8ea3-d05bbdc36aff) Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.506112 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:27:21.507696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 00:27:21.509104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1f41de3e-174a-4caf-8bed-c24c0d19bf26 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] Returning 404 to user: Volume 898a3acc-23e5-4fdf-892c-ef0e51a78510 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1f41de3e-174a-4caf-8bed-c24c0d19bf26 tempest-VolumesSnapshotsTestJSON-725267216 tempest-VolumesSnapshotsTestJSON-725267216-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510" status: 404 len: 109 microversion: 2.1 time: 0.040088 Oct 12 00:27:21.510723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 458/921] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:21 2022] GET /compute/v2.1/os-volumes/898a3acc-23e5-4fdf-892c-ef0e51a78510 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:21.734288 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:21.735046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:21.741924 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.745691 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.746140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.746851 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:21.747529 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:21.747961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:21.957824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:21.968251 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:21.970025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:21.971517 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d6cb23df-41f8-47e7-b20b-a79746e48deb tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1674 microversion: 2.20 time: 0.241353 Oct 12 00:27:21.972790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 464/922] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:21 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1674 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:22.747000 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:22.747607 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:22.754489 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:22.755290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:22.755943 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:22.756868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:22.757528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:22.758020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:22.773782 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 HTTP/1.1 Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:22.775503 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.776852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '84d5f38e-5fbf-4a54-adf9-6025f1358776'} Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:22.777722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.778945 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.780185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:22.780185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e9325186-cb2d-4741-9d5a-4cc0e5d6736a tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "DELETE /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 404 len: 111 microversion: 2.1 time: 0.035312 Oct 12 00:27:22.780185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 459/923] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:27:22 2022] DELETE /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:22.785649 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:22.789289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] [instance: 84d5f38e-5fbf-4a54-adf9-6025f1358776] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:22.792542 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:22.793281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:22.793860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:22.805111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:22.806970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:22.808885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:22.830863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] HTTP exception thrown: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Request method failure captured: Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 HTTP/1.1 Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgg5fIEQ9L7fUCbBvi5RPdMYkTsBj1F_J-ksOHXGk8C2DcIXvOUoQkjtaMk2uoV8nC_Bq5KwkdFtXuVUUWrdj-GhHcAffsCDvaXQLAdiZ3osbaQtKENuORVQnS0Yt4FXJVGjSHNUp4om6SAg1ZoIp9co61iTSWFaEyZDH5Ro3c0J1Lw Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:27:22.841172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_10160596b45c49249155b0c2585e70bb", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/10160596b45c49249155b0c2585e70bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/10160596b45c49249155b0c2585e70bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 10160596b45c49249155b0c2585e70bb Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-127190093 Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: de766cb582ba4c18b1fda9bf4ad43f65 Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-127190093-project Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.842746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '84d5f38e-5fbf-4a54-adf9-6025f1358776'} Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:22.843497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. Oct 12 00:27:22.845162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:27:22.848071 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] Returning 404 to user: Instance 84d5f38e-5fbf-4a54-adf9-6025f1358776 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:22.848071 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bf54b7fa-8f47-4cf3-b758-72c7b08d0e44 tempest-AttachVolumeNegativeTest-127190093 tempest-AttachVolumeNegativeTest-127190093-project] 10.222.0.36 "GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776" status: 404 len: 111 microversion: 2.1 time: 0.060883 Oct 12 00:27:22.853957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 465/924] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:22 2022] GET /compute/v2.1/servers/84d5f38e-5fbf-4a54-adf9-6025f1358776 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:22.997489 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:22.998381 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:23.007891 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:23.010284 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:23.010911 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:23.012373 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:23.014095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:23.015887 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:23.294523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:23.302421 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:23.305481 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:23.310440 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:23.321506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-639f7a74-a2d6-402c-81df-077a9eafcf2a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.318699 Oct 12 00:27:23.322171 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 460/925] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:22 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:24.358712 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:24.360534 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:24.377511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:24.382675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:24.383208 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:24.384025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:24.384634 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:24.385163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:24.666791 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8e6294c4-b3bd-44dd-bd2e-ec61079eeb1e tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Action: 'create', calling method: .version_select at 0x7f2fe8d29af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-711894347", "metadata": {"Type": "work"}}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:24.725239 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:24.737181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:24.758532 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:24.764082 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e56cb315-04c2-4045-806f-bb88f937a08d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.410423 Oct 12 00:27:24.767559 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 466/926] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:24 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:25.803509 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:25.816224 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:25.840778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8e6294c4-b3bd-44dd-bd2e-ec61079eeb1e tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.350640 Oct 12 00:27:25.841252 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:25.841366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:25.841899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:25.846357 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:25.847873 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:25.848898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:25.851287 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 461/927] 10.222.0.36 () {60 vars in 1156 bytes} [Wed Oct 12 00:27:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1362 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 12 00:27:25.856255 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-05712a43-8dff-4606-bb94-2cc69755b00f tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Calling method '.version_select at 0x7f2fe8ca4160>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:25.993891 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-05712a43-8dff-4606-bb94-2cc69755b00f tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538" status: 200 len: 352 microversion: 2.1 time: 0.141343 Oct 12 00:27:25.994468 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 462/928] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:25 2022] GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538 => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:26.312384 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:26.328214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:26.335439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:26.335439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-398b93fd-bd03-44cd-a467-2b1482fdd7e5 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.535012 Oct 12 00:27:26.335439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 467/929] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:25 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:27:27.014220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ed193f95-6422-455d-92de-3f63902004fd tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Calling method '.version_select at 0x7f2fe8cd4040>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:27.137462 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ed193f95-6422-455d-92de-3f63902004fd tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538" status: 200 len: 353 microversion: 2.1 time: 0.131648 Oct 12 00:27:27.147952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 463/930] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:27 2022] GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:27.152599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1fb70c11-87d6-461e-a1f2-1fb35b0ee182 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Calling method '.version_select at 0x7f2fe8c9da60>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:27.257795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1fb70c11-87d6-461e-a1f2-1fb35b0ee182 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538" status: 200 len: 353 microversion: 2.1 time: 0.109258 Oct 12 00:27:27.258558 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 468/931] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:27 2022] GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:27:27.283814 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2a689f58-e782-45eb-a257-ee8a1f467e47 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Calling method '.version_select at 0x7f2fe8d29e50>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:27.364390 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:27.365464 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:27.380963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:27.381613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:27.386963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:27.390746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:27.390746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:27.390746 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:27.527220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2a689f58-e782-45eb-a257-ee8a1f467e47 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538" status: 202 len: 0 microversion: 2.1 time: 0.248466 Oct 12 00:27:27.531913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 464/932] 10.222.0.36 () {58 vars in 1248 bytes} [Wed Oct 12 00:27:27 2022] DELETE /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:27:27.550616 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-04003583-3446-48d3-87f9-0f06a6f6338f tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Calling method '.version_select at 0x7f2fe8d343a0>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:27.659149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-04003583-3446-48d3-87f9-0f06a6f6338f tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538" status: 200 len: 352 microversion: 2.1 time: 0.125729 Oct 12 00:27:27.660245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 465/933] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:27 2022] GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:27.685290 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:27.694014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:27.696759 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:27.698360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f9480407-29ae-4939-843a-2773f70a0155 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.338399 Oct 12 00:27:27.762863 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 469/934] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:27 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 00:27:28.674597 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a18252f8-1a91-4802-9773-d505d0b74719 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Calling method '.version_select at 0x7f2fe8cc0790>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:28.726380 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:28.728153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:28.746325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:28.749653 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-a18252f8-1a91-4802-9773-d505d0b74719 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] HTTP exception thrown: Volume c9b15fd2-45c5-42ba-9e29-69c63f65d538 could not be found. Oct 12 00:27:28.749912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:28.749912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a18252f8-1a91-4802-9773-d505d0b74719 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Request method failure captured: Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538 HTTP/1.1 Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgns520Je_JLxjjv6CLOgL55iG2rf-oeBxqf9U8ON3Uz-dOTF6-xNU798apHg9bFkcbbXxWpI_DqCsX85ZVndKIM7-r7NihNhrvGI9RrWNMVWFy2z0UmcDcqrBqfcr7ny8zKKACmw4cTqJHJ2laUJZj5fs79wn2VmCfC9AIHjfAQ6_c Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: f2d4c8d338614442b692b20f3bcb87f9 Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-VolumesGetTestJSON-2035120065 Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:27:28.750101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f2d4c8d338614442b692b20f3bcb87f9", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d4c8d338614442b692b20f3bcb87f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f2d4c8d338614442b692b20f3bcb87f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f2d4c8d338614442b692b20f3bcb87f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-VolumesGetTestJSON-2035120065 Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: f2d4c8d338614442b692b20f3bcb87f9 Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-VolumesGetTestJSON-2035120065 Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-VolumesGetTestJSON-2035120065-project Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: 236491bea40f48839993bd1aa4f53dd2 Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-VolumesGetTestJSON-2035120065-project Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Volume c9b15fd2-45c5-42ba-9e29-69c63f65d538 could not be found. Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'c9b15fd2-45c5-42ba-9e29-69c63f65d538'} Oct 12 00:27:28.751689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9b15fd2-45c5-42ba-9e29-69c63f65d538 could not be found. (HTTP 404) (Request-ID: req-a4addad1-dc54-4a40-bb01-db654bbc3728) Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:28.752775 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 00:27:28.754367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9b15fd2-45c5-42ba-9e29-69c63f65d538 could not be found. Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 00:27:28.755813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9b15fd2-45c5-42ba-9e29-69c63f65d538 could not be found. Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9b15fd2-45c5-42ba-9e29-69c63f65d538 could not be found. Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a18252f8-1a91-4802-9773-d505d0b74719 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] Returning 404 to user: Volume c9b15fd2-45c5-42ba-9e29-69c63f65d538 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a18252f8-1a91-4802-9773-d505d0b74719 tempest-VolumesGetTestJSON-2035120065 tempest-VolumesGetTestJSON-2035120065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538" status: 404 len: 109 microversion: 2.1 time: 0.080129 Oct 12 00:27:28.757310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 466/935] 10.222.0.36 () {58 vars in 1245 bytes} [Wed Oct 12 00:27:28 2022] GET /compute/v2.1/os-volumes/c9b15fd2-45c5-42ba-9e29-69c63f65d538 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:27:28.761554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:28.761554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:28.761554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:29.154232 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:29.164852 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:29.166283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:29.167479 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-480cdd4e-45e9-4cfe-ae3d-61f0769e3797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.446465 Oct 12 00:27:29.174756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 470/936] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:28 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:30.200915 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:30.201892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:30.216561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:30.219216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:30.219694 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:30.220530 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:30.222242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:30.222676 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:30.618647 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:30.628482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:30.629947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:30.631326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6849b3b6-4156-46f3-985c-21c8c39041b0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.434304 Oct 12 00:27:30.631911 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 467/937] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:30 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:31.658593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:31.660245 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:31.666426 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:31.672574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:31.688459 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:31.691057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:31.702756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:31.702756 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:31.738797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:32.048174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:32.065276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:32.066918 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:32.069009 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c8d9322e-5269-4a35-9159-2cf95bd20f74 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.414082 Oct 12 00:27:32.093826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 471/938] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:31 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:32.502604 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8be5317b-e4e2-407a-b2dc-f3d63b4b6dbf tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Action: 'create', calling method: .version_select at 0x7f2fe8d9b940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1677283004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1MaRxcV4pTnJz/+OTfW8RFkI8oVdYRufZl+YNiIxiEkhinTJ20kSU/iVsvT7iJSFNsw7BUS0byN8WU8FBGMbqBez64qlrybGLLiBKHVlwKoP/8Pl8FzMG5wuCUjF3rkw=="}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:32.559701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-8be5317b-e4e2-407a-b2dc-f3d63b4b6dbf tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Getting quotas for project 654843d065264b9e9296824daf702110. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:27:32.582659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-8be5317b-e4e2-407a-b2dc-f3d63b4b6dbf tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Getting quotas for user da2a3fcb0287474cb93238923aa9c7c1 and project 654843d065264b9e9296824daf702110. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:27:32.688274 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8be5317b-e4e2-407a-b2dc-f3d63b4b6dbf tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.530767 Oct 12 00:27:32.689458 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 468/939] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:27:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:33.096062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:33.097876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:33.109268 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:33.109761 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:33.110248 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:33.110960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:33.111495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:33.114085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:33.319429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:33.330276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:33.332049 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:33.339532 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5858eb4b-a319-4301-978d-b5ec405bce0a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.242000 Oct 12 00:27:33.339532 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 472/940] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:33 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:34.361376 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:34.363672 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:34.366974 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:34.376212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:34.377005 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:34.377761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:34.389667 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:34.399605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:34.401235 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:34.709431 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:34.709431 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:34.709827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:34.709827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-965d2249-d397-4b28-8ae7-04117958c8b3 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.332730 Oct 12 00:27:34.709827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 469/941] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:34 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:35.735841 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:35.736725 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:35.748106 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:35.750923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:35.750923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:35.750923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:35.750923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:35.751446 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:36.019619 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:36.030090 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:36.032348 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:36.033804 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1487489f-e47d-4d7e-803e-e275cec12d4a tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.302149 Oct 12 00:27:36.049073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 473/942] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:35 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:37.062443 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:37.063080 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:37.070392 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:37.070841 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:37.071270 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:37.071983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:37.072434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:37.072852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:37.203632 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:37.212785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:37.214132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:37.214910 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3552045d-2896-4d58-817c-804a78f9ad5b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.156779 Oct 12 00:27:37.215486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 470/943] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:37 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:38.243768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:38.243768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:38.249789 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:38.251160 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:38.251687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:38.252120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:38.253423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:38.253882 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:38.254317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:38.404103 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:38.412585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:38.414089 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:38.415239 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f3d901b8-a41e-4b17-9c64-5f76e03ad61c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.178587 Oct 12 00:27:38.415865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 474/944] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:38 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:39.440509 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:39.441130 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:39.452093 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:39.452696 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:39.453341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:39.454064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:39.454650 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:39.455227 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:39.631885 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:39.645144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:39.647119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:39.648869 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-65a7dd9a-357c-4a80-8f4d-0344e2c21797 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.212693 Oct 12 00:27:39.649941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 471/945] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:39 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:40.675255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:40.675912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:40.683174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:40.683714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:40.684165 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:40.684882 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:40.685286 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:40.685735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:40.841276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:40.850965 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:40.852409 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:40.853610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3e5e5429-4604-467d-83c3-efab83bc2183 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.182911 Oct 12 00:27:40.854313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 475/946] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:40 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:41.607279 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-bc2f8f7a-bc17-43b2-bd2b-8c0c70560688 req-2bffd2d8-9ede-4b53-96a6-bb089f2b775f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facea60e-d753-4eda-b9f7-932b0cf5a63b", "name": "network-vif-plugged", "status": "completed", "tag": "ff37e4cb-00cf-4bd1-b77a-3dffa69e456e"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:41.619736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-bc2f8f7a-bc17-43b2-bd2b-8c0c70560688 req-2bffd2d8-9ede-4b53-96a6-bb089f2b775f service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:41.620284 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-bc2f8f7a-bc17-43b2-bd2b-8c0c70560688 req-2bffd2d8-9ede-4b53-96a6-bb089f2b775f service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:41.620868 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-bc2f8f7a-bc17-43b2-bd2b-8c0c70560688 req-2bffd2d8-9ede-4b53-96a6-bb089f2b775f service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:41.634307 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-bc2f8f7a-bc17-43b2-bd2b-8c0c70560688 req-2bffd2d8-9ede-4b53-96a6-bb089f2b775f service nova] Creating event network-vif-plugged:ff37e4cb-00cf-4bd1-b77a-3dffa69e456e for instance facea60e-d753-4eda-b9f7-932b0cf5a63b on hv-cinder-84914 Oct 12 00:27:41.639452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-bc2f8f7a-bc17-43b2-bd2b-8c0c70560688 req-2bffd2d8-9ede-4b53-96a6-bb089f2b775f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036112 Oct 12 00:27:41.640209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 472/947] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:27:41.881673 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:41.887434 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:41.889608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:41.890139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:41.890577 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:41.891283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:41.891766 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:41.892495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:42.037442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:42.046408 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:42.048273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:42.049451 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fff5d01e-d243-4080-b0db-6c3da9446278 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.171693 Oct 12 00:27:42.050005 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 476/948] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:41 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:43.071663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=4 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:43.076876 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:43.077586 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:43.084136 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:43.084625 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:43.085064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:43.085760 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:43.086214 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:43.086636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:43.224367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:43.232596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:43.234126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:43.235267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7f666dbf-3b04-4f3d-8ee3-569a629ad49c tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.164807 Oct 12 00:27:43.235884 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 473/949] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:43 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:44.261613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:44.262321 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:44.269129 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:44.269599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:44.270025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:44.270720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:44.271155 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:44.271593 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:44.410046 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:44.418349 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:44.420070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:44.421235 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8c878be9-615c-4f21-80d1-3727d483a5d1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.163475 Oct 12 00:27:44.421839 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 477/950] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:44 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:45.446654 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:45.447316 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:45.454064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:45.454541 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:45.454973 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:45.455690 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:45.456767 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:45.457203 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:45.593520 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:45.602167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:45.603649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:45.604808 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-508300ec-8c08-427a-9c63-78148851d616 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.162150 Oct 12 00:27:45.605363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 474/951] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:45 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:46.631047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:46.635898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:46.642929 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:46.644164 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:46.644598 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:46.645302 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:46.645753 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:46.646175 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:46.804749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:46.814297 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:46.815823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:46.816986 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ef9b971a-e7ab-4d16-b25c-c6044ae419be tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.190526 Oct 12 00:27:46.817842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 478/952] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:46 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:47.844212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:47.844816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:47.851165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:47.851682 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:47.852108 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:47.852791 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:47.853237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:47.853651 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:47.988972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:48.001903 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:48.004337 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:48.005501 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e632ca8f-0be3-4585-866e-c7e4cd0ce8e1 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1730 microversion: 2.20 time: 0.165248 Oct 12 00:27:48.013310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 475/953] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:47 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:49.030134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:49.030655 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:49.037640 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:49.038366 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:49.038620 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:49.039306 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:49.039777 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:49.040194 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:49.178672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:49.186862 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:49.188523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:49.190062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1e2dd1ef-e536-4820-ac6f-2f4b57ca5bad tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1717 microversion: 2.20 time: 0.163865 Oct 12 00:27:49.191554 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 479/954] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:27:49 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:27:57.344495 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1938427524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1677283004", "security_groups": [{"name": "tempest-secgroup-smoke-713553876"}], "networks": [{"uuid": "0fd75ea6-44b5-4c93-a3aa-fbdedbce1910"}], "block_device_mapping_v2": [{"uuid": "1a62ad05-54ea-4ece-ba4c-18610c4f5174", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:27:57.458926 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] validate_networks() for [('0fd75ea6-44b5-4c93-a3aa-fbdedbce1910', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:27:57.817058 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:27:57.817475 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:27:57.817941 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:27:57.818347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:27:57.818749 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:27:57.830312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:57.830312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:57.830312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:57.830312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:57.830612 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:57.830612 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:57.837216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=46 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:27:57.847938 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Getting quotas for project 654843d065264b9e9296824daf702110. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:27:57.851938 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Getting quotas for user da2a3fcb0287474cb93238923aa9c7c1 and project 654843d065264b9e9296824daf702110. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:27:57.916410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:27:57.916410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a62ad05-54ea-4ece-ba4c-18610c4f5174',volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:27:58.350635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d308e47f-e5d0-499e-b878-bbadfeb32997 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.010209 Oct 12 00:27:58.351286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 476/955] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:27:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:27:58.372687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2b034aef-90e8-40ee-965a-c845f4b46d72 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:58.373347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2b034aef-90e8-40ee-965a-c845f4b46d72 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:58.428147 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2b034aef-90e8-40ee-965a-c845f4b46d72 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:58.435010 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2b034aef-90e8-40ee-965a-c845f4b46d72 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1089 microversion: 2.1 time: 0.075701 Oct 12 00:27:58.435642 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 480/956] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:58 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1089 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:27:59.457804 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:27:59.458415 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:27:59.465002 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:59.465482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:59.465922 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:59.466615 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:27:59.470115 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:27:59.470115 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:27:59.544735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:27:59.553719 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-16ae4c16-eb50-4de7-82b9-8805a62b7f1e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1139 microversion: 2.1 time: 0.100126 Oct 12 00:27:59.554278 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 477/957] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:27:59 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1139 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:00.584404 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:00.586776 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:00.591859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=50 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:00.598571 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:00.599230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:00.600041 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:00.600812 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:00.601423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:00.601916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:00.675579 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:00.682949 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c28cbf0c-14f3-4b3e-9b30-99f940f8559c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1187 microversion: 2.1 time: 0.110487 Oct 12 00:28:00.683556 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 481/958] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:00 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1187 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:28:01.711807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:01.712537 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:01.718645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:01.719122 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:01.719589 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:01.720366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:01.720846 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:01.721268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:02.008879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:02.020985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-eed947b5-b279-40c2-b25c-f2a37eb68461 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1272 microversion: 2.1 time: 0.309757 Oct 12 00:28:02.020985 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 478/959] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:01 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:02.543036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-15180ff5-893e-4643-97fc-e772f516ae05 req-22f99edf-79c7-46eb-ade1-d00f3dadb4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23fd934-b03a-4259-8fd8-8dbcc42be866", "tag": "4ad8437d-d747-4320-afc4-1d72d58b1f96"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:28:02.555623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-15180ff5-893e-4643-97fc-e772f516ae05 req-22f99edf-79c7-46eb-ade1-d00f3dadb4a5 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:02.556105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-15180ff5-893e-4643-97fc-e772f516ae05 req-22f99edf-79c7-46eb-ade1-d00f3dadb4a5 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:02.556536 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-15180ff5-893e-4643-97fc-e772f516ae05 req-22f99edf-79c7-46eb-ade1-d00f3dadb4a5 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:02.567672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-15180ff5-893e-4643-97fc-e772f516ae05 req-22f99edf-79c7-46eb-ade1-d00f3dadb4a5 service nova] Creating event network-changed:4ad8437d-d747-4320-afc4-1d72d58b1f96 for instance b23fd934-b03a-4259-8fd8-8dbcc42be866 on hv-cinder-84914 Oct 12 00:28:02.572437 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-15180ff5-893e-4643-97fc-e772f516ae05 req-22f99edf-79c7-46eb-ade1-d00f3dadb4a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033356 Oct 12 00:28:02.573025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 482/960] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:28:03.044504 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:03.045172 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:03.052322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:03.052816 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:03.053330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:03.055867 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:03.056522 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:03.057523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:03.541197 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:03.564646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-86228d88-92af-4874-8458-f2c32838b9ac tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.518756 Oct 12 00:28:03.564646 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 479/961] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:03 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:04.588121 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:04.588825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:04.594858 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:04.595331 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:04.595790 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:04.596493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:04.596940 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:04.597359 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:04.753241 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:04.761167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ecc016fb-3f80-41b0-92d1-958f6eafa744 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.178755 Oct 12 00:28:04.761763 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 483/962] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:04 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:05.783888 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:05.784461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:05.791212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:05.795621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:05.795621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:05.795621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:05.795621 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:05.796108 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:05.931987 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:05.939796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-794111c3-34a5-4dfe-8230-063c11111098 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.159729 Oct 12 00:28:05.940352 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 480/963] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:05 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:06.963075 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:06.963844 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:06.970321 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:06.970797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:06.971223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:06.971938 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:06.972383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:06.972799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:07.106336 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:07.114179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a3ff5772-d285-4fec-ab0d-ca40629960bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.155859 Oct 12 00:28:07.115298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 484/964] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:06 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:08.137904 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:08.138628 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:08.140956 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:08.144104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=6 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:08.147215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:08.147720 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:08.148149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:08.148827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:08.149271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:08.149692 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:08.284477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:08.292291 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c36d75fe-5b6f-4971-812e-842e60510e33 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.158134 Oct 12 00:28:08.293032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 481/965] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:08 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:09.314326 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:09.314935 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:09.317400 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:09.323565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:09.324051 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:09.324484 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:09.325183 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:09.325635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:09.326059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:09.459663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:09.467912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-993ebf66-d2f3-4ceb-a5a0-dd13f8a7a44f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.157313 Oct 12 00:28:09.468478 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 485/966] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:09 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:10.491417 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:10.492024 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:10.498596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:10.499084 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:10.499560 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:10.501519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:10.501519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:10.501519 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:10.636342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:10.644362 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-67df8321-7059-45fe-ba8d-6f762594dafe tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.157251 Oct 12 00:28:10.645117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 482/967] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:10 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:11.665891 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:11.666503 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:11.668812 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=26 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:11.673408 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:11.673885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:11.674318 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:11.675063 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:11.675541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:11.679662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:11.805050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:11.812890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-046684d0-360f-4559-8506-9bbf4945b465 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.150785 Oct 12 00:28:11.813495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 486/968] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:11 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:12.836701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:12.837324 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:12.839661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:12.844390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:12.846838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:12.846838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:12.846838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:12.846838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:12.847318 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:12.975762 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:12.983317 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e24c8919-d251-43a1-af8f-89a6e0e67d4a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.151402 Oct 12 00:28:12.983907 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 483/969] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:12 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:14.005211 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:14.005824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:14.012198 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:14.012675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:14.013106 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:14.013795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:14.014245 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:14.014663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:14.145058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:14.153052 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d2f50c41-127a-4a36-b51f-6498e136963a tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.151717 Oct 12 00:28:14.153631 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 487/970] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:14 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:14.681310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-37004295", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452"}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:28:14.733980 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] validate_networks() for None {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:28:15.023010 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:28:15.023458 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:28:15.023935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:28:15.024400 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:28:15.024753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:28:15.033731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:15.034234 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:15.034668 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:15.035423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:15.035876 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:15.036300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:15.052898 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Getting quotas for project 90c1e5e7db4942dea48cd03d186bb033. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:28:15.056639 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Getting quotas for user 0579e56a0b0b434389706f8f0b236ce3 and project 90c1e5e7db4942dea48cd03d186bb033. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:28:15.067297 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:28:15.070067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:28:15.175618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:15.176219 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:15.183121 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:15.183628 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:15.184055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:15.184733 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:15.185177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:15.185588 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:15.210861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-76fdf1ca-e889-46af-86fb-020b1a96fa40 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533368 Oct 12 00:28:15.211766 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 484/971] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:28:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:28:15.222637 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-64a93712-8eda-4929-8f9c-d90052cfedd3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:15.223248 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-64a93712-8eda-4929-8f9c-d90052cfedd3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:15.278849 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-64a93712-8eda-4929-8f9c-d90052cfedd3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:15.286997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-64a93712-8eda-4929-8f9c-d90052cfedd3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1213 microversion: 2.1 time: 0.067468 Oct 12 00:28:15.288068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 485/972] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:15 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:15.330699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:15.338443 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-38adf0a9-152b-49fa-a442-70e50ad327bb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.166762 Oct 12 00:28:15.339095 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 488/973] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:15 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:28:16.309450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:16.310056 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:16.316150 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:16.316633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:16.317067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:16.317754 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:16.318204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:16.319340 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:16.361311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:16.361922 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:16.368298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:16.368784 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:16.369216 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:16.369912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:16.370369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:16.370788 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:16.383284 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:16.390990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d0b2d60d-6455-47f1-9d7b-ca73a83dc8a3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1217 microversion: 2.1 time: 0.085461 Oct 12 00:28:16.391585 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 486/974] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:16 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:16.506793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:16.514489 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d154608f-0c9a-4ccb-9100-da2cccba49e1 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.156967 Oct 12 00:28:16.515049 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 489/975] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:16 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:28:17.414010 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:17.414701 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:17.421247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:17.421799 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:17.422296 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:17.423053 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:17.423601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:17.424113 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:17.488459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:17.496450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-35dfad12-8ea0-4772-9491-4609c01c13cf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1265 microversion: 2.1 time: 0.086962 Oct 12 00:28:17.497337 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 487/976] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:17 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:17.536493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:17.537199 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:17.543806 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:17.549481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:17.549481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:17.549481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:17.549481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:17.549841 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:17.679312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:17.687123 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b5df589c-bac6-4083-8dfb-b4d1fcc9e9a3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.154479 Oct 12 00:28:17.687720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 490/977] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:17 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:18.519944 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:18.520579 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:18.527014 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:18.531432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:18.531432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:18.531432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:18.531432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:18.531810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:18.641379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:18.650300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8f20683a-eb45-4123-8e34-3068e5e67c57 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1271 microversion: 2.1 time: 0.134484 Oct 12 00:28:18.663440 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 488/978] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:18 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:18.710176 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:18.712189 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:18.720842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:18.720842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:18.720842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:18.720842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:18.721238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:18.721238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:18.786749 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-2d496147-401e-4717-a8ed-1a0c74041ba4 req-d1cd3036-e297-4899-9993-005ca6cbf198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23fd934-b03a-4259-8fd8-8dbcc42be866", "name": "network-vif-plugged", "status": "completed", "tag": "4ad8437d-d747-4320-afc4-1d72d58b1f96"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:28:18.804167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2d496147-401e-4717-a8ed-1a0c74041ba4 req-d1cd3036-e297-4899-9993-005ca6cbf198 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:18.804950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2d496147-401e-4717-a8ed-1a0c74041ba4 req-d1cd3036-e297-4899-9993-005ca6cbf198 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:18.805589 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2d496147-401e-4717-a8ed-1a0c74041ba4 req-d1cd3036-e297-4899-9993-005ca6cbf198 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:18.818131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-2d496147-401e-4717-a8ed-1a0c74041ba4 req-d1cd3036-e297-4899-9993-005ca6cbf198 service nova] Creating event network-vif-plugged:4ad8437d-d747-4320-afc4-1d72d58b1f96 for instance b23fd934-b03a-4259-8fd8-8dbcc42be866 on hv-cinder-84914 Oct 12 00:28:18.825553 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-2d496147-401e-4717-a8ed-1a0c74041ba4 req-d1cd3036-e297-4899-9993-005ca6cbf198 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042373 Oct 12 00:28:18.826319 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 489/979] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:28:19.020508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:19.025173 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7fe97d62-7cd6-4bfe-9eba-ac68fd0c9ad0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.318881 Oct 12 00:28:19.025749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 491/980] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:18 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:19.681555 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:19.681555 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:19.685063 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:19.685543 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:19.685977 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:19.686664 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:19.687119 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:19.687576 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:19.902706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:19.910593 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-13f8c701-c5ee-4489-b117-8e73562296b3 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1313 microversion: 2.1 time: 0.237613 Oct 12 00:28:19.911167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 490/981] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:19 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:20.048423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:20.049107 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:20.056137 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:20.056621 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:20.057053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:20.057749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:20.058204 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:20.058624 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:20.142179 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-12e3ef8c-4f5e-4fe3-9b33-2551eea9d10c req-bf72926e-4b37-4c78-a506-4445d708a636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d25af614-f5f9-426d-b95e-b13786d5a2ec", "tag": "2bd2985e-d3fc-45a4-a290-2e60bb7e6f6d"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:28:20.152717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-12e3ef8c-4f5e-4fe3-9b33-2551eea9d10c req-bf72926e-4b37-4c78-a506-4445d708a636 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:20.154323 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-12e3ef8c-4f5e-4fe3-9b33-2551eea9d10c req-bf72926e-4b37-4c78-a506-4445d708a636 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:20.154323 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-12e3ef8c-4f5e-4fe3-9b33-2551eea9d10c req-bf72926e-4b37-4c78-a506-4445d708a636 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:20.164388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-12e3ef8c-4f5e-4fe3-9b33-2551eea9d10c req-bf72926e-4b37-4c78-a506-4445d708a636 service nova] Creating event network-changed:2bd2985e-d3fc-45a4-a290-2e60bb7e6f6d for instance d25af614-f5f9-426d-b95e-b13786d5a2ec on hv-cinder-84914 Oct 12 00:28:20.170094 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-12e3ef8c-4f5e-4fe3-9b33-2551eea9d10c req-bf72926e-4b37-4c78-a506-4445d708a636 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031301 Oct 12 00:28:20.170703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 491/982] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:28:20.197740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:20.205559 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-27a42fc0-a30c-4637-967d-cf56bb9fc062 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1260 microversion: 2.1 time: 0.160960 Oct 12 00:28:20.206118 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 492/983] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:20 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:20.935281 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:20.936006 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:20.942378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:20.942860 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:20.943329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:20.944043 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:20.944494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:20.944942 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:21.116117 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:21.124432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-66d62f89-5a4f-4c7f-92c4-77337fa7d4e0 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1313 microversion: 2.1 time: 0.194723 Oct 12 00:28:21.125004 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 492/984] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:20 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:21.228828 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:21.229918 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:21.236358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:21.236844 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:21.237273 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:21.237971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:21.238422 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:21.238842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:21.368945 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:21.377579 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b8ea6062-f74b-4434-b0c0-691aaeec7622 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1444 microversion: 2.1 time: 0.152634 Oct 12 00:28:21.378238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 493/985] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:21 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:21.399913 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:21.400517 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:21.406512 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:21.406994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:21.407442 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:21.408126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:21.408574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:21.408986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:21.545070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:21.552953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-dc504760-b95e-4b04-8d66-fa3235de8d5f tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1444 microversion: 2.1 time: 0.156885 Oct 12 00:28:21.553516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 493/986] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:21 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:22.154133 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:22.154851 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:22.160741 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:22.161223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:22.161654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:22.162382 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:22.162808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:22.163223 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:22.370931 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:22.378734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-32dd4a22-b9ca-43e1-b5c0-f4bb281e2450 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1313 microversion: 2.1 time: 0.228471 Oct 12 00:28:22.379519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 494/987] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:22 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:23.402086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:23.402837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:23.409538 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:23.410011 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:23.410442 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:23.411132 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:23.411614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:23.412040 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:23.554204 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:23.563276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-dcc18ace-ec3f-423e-9db5-100b8bd646c9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1313 microversion: 2.1 time: 0.165016 Oct 12 00:28:23.564098 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 494/988] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:23 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:23.712164 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-05b919f2-cf48-4d4c-916e-88365025a2a7 req-2151d060-1fba-4374-bd0f-9b094a676442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23fd934-b03a-4259-8fd8-8dbcc42be866", "tag": "4ad8437d-d747-4320-afc4-1d72d58b1f96"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:28:23.724460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-05b919f2-cf48-4d4c-916e-88365025a2a7 req-2151d060-1fba-4374-bd0f-9b094a676442 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:23.724876 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-05b919f2-cf48-4d4c-916e-88365025a2a7 req-2151d060-1fba-4374-bd0f-9b094a676442 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:23.725775 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-05b919f2-cf48-4d4c-916e-88365025a2a7 req-2151d060-1fba-4374-bd0f-9b094a676442 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:23.738125 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-05b919f2-cf48-4d4c-916e-88365025a2a7 req-2151d060-1fba-4374-bd0f-9b094a676442 service nova] Creating event network-changed:4ad8437d-d747-4320-afc4-1d72d58b1f96 for instance b23fd934-b03a-4259-8fd8-8dbcc42be866 on hv-cinder-84914 Oct 12 00:28:23.743956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-05b919f2-cf48-4d4c-916e-88365025a2a7 req-2151d060-1fba-4374-bd0f-9b094a676442 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035288 Oct 12 00:28:23.745110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 495/989] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:28:24.586857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:24.588151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:24.594578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:24.595062 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:24.595536 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:24.596230 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:24.596683 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:24.597110 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:24.725292 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-54d54219-d029-401a-9123-a05e0b8ee475 req-6b07ba6c-ba15-41ac-97e8-6010b8d4f004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25af614-f5f9-426d-b95e-b13786d5a2ec", "name": "network-vif-plugged", "status": "completed", "tag": "2bd2985e-d3fc-45a4-a290-2e60bb7e6f6d"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:28:24.739120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-54d54219-d029-401a-9123-a05e0b8ee475 req-6b07ba6c-ba15-41ac-97e8-6010b8d4f004 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:24.739120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-54d54219-d029-401a-9123-a05e0b8ee475 req-6b07ba6c-ba15-41ac-97e8-6010b8d4f004 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:24.739120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-54d54219-d029-401a-9123-a05e0b8ee475 req-6b07ba6c-ba15-41ac-97e8-6010b8d4f004 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:24.739529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:24.746785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5432f0fb-1700-4c93-8367-83b6d3337ff9 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1313 microversion: 2.1 time: 0.163855 Oct 12 00:28:24.747725 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 495/990] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:24 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:24.764064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-54d54219-d029-401a-9123-a05e0b8ee475 req-6b07ba6c-ba15-41ac-97e8-6010b8d4f004 service nova] Creating event network-vif-plugged:2bd2985e-d3fc-45a4-a290-2e60bb7e6f6d for instance d25af614-f5f9-426d-b95e-b13786d5a2ec on hv-cinder-84914 Oct 12 00:28:24.769758 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-54d54219-d029-401a-9123-a05e0b8ee475 req-6b07ba6c-ba15-41ac-97e8-6010b8d4f004 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049091 Oct 12 00:28:24.770401 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 496/991] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:28:25.771432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:25.772046 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:25.775086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:25.775797 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=8 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:25.780370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:25.780865 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:25.781281 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:25.781974 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:25.782425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:25.783759 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:25.797434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=100 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:25.911051 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:25.920065 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-04e288fd-30f0-4b7e-b151-19cf5df752b6 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1313 microversion: 2.1 time: 0.152497 Oct 12 00:28:25.920637 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 496/992] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:25 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:26.942165 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:26.943168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:26.949802 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:26.950283 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:26.950721 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:26.951440 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:26.951899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:26.952323 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:27.080963 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:27.088690 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1d940263-4816-409b-9b21-3ac0fbd7011e tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1463 microversion: 2.1 time: 0.150732 Oct 12 00:28:27.089250 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 497/993] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:26 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:27.135397 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:27.136044 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:27.143529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:27.144143 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:27.144675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:27.145463 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:27.146015 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:27.146537 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:27.171545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:28:27.364045 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a37ba51e-add0-4a9d-9b36-a1d3b30e3d46 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 204 len: 0 microversion: 2.1 time: 0.232511 Oct 12 00:28:27.364632 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 497/994] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:28:27 2022] DELETE /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:28:27.372751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:27.373442 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:27.379466 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:27.379941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:27.380369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:27.381047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:27.381500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:27.381918 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:27.508284 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:27.516033 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bd0def10-73dc-4b98-b53f-093250b96f88 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1469 microversion: 2.1 time: 0.146941 Oct 12 00:28:27.516493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 498/995] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:27 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:28.540140 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:28.540802 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:28.546978 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:28.547482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:28.547915 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:28.548605 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:28.549055 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:28.549478 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:28.676005 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:28.684341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a2f5438a-895d-44c8-b509-a11b4aa10320 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1469 microversion: 2.1 time: 0.148584 Oct 12 00:28:28.684958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 498/996] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:28 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:29.707030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:29.707661 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:29.714050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:29.715271 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:29.715754 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:29.716433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:29.716880 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:29.717296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:29.735115 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:28:29.848417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:29.856044 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6f0ff67c-6d8e-4b98-a4a0-49784e04dbcf tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1469 microversion: 2.1 time: 0.153090 Oct 12 00:28:29.856612 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 499/997] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:29 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:30.879423 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:30.880070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:30.887341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:30.887850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:30.888283 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:30.888999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:30.889450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:30.889871 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:31.097471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:31.099837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:31.107430 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:31.108455 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:31.108959 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:31.109748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:31.110429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:31.110916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:31.142826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-083ce605-9050-4fb8-a36f-a6bc6b5653f0 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049527 Oct 12 00:28:31.143620 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 500/998] 10.222.0.36 () {60 vars in 1343 bytes} [Wed Oct 12 00:28:31 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:28:31.213371 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:31.213772 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:31.220136 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:31.220623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:31.221055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:31.221761 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:31.222210 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:31.222632 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:31.249734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:28:31.364844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:31.372869 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b9cb7f51-2065-49f4-8512-cad84c4635ab tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1469 microversion: 2.1 time: 0.497301 Oct 12 00:28:31.373717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 499/999] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:30 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1469 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:31.552597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c86819a3-c93d-4f97-b112-eb3b11331b0e tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "DELETE /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 204 len: 0 microversion: 2.20 time: 0.343028 Oct 12 00:28:31.553185 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 501/1000] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Oct 12 00:28:31 2022] DELETE /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 12 00:28:31.561337 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:31.562052 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:31.568734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:31.571823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:31.571823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:31.571823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:31.571823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:31.572276 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:31.724641 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:31.733328 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:31.735459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:31.737070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8450d148-b076-4eba-8601-2be3ca819276 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.179223 Oct 12 00:28:31.751699 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 500/1001] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:28:31 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:28:31.835254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-51d30e32-fe44-4227-b43e-8f9555e53bb1 req-23d196a0-7e25-4646-bbb7-99d3a25e804f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d25af614-f5f9-426d-b95e-b13786d5a2ec", "name": "network-vif-deleted", "tag": "2bd2985e-d3fc-45a4-a290-2e60bb7e6f6d"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:28:31.846368 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-51d30e32-fe44-4227-b43e-8f9555e53bb1 req-23d196a0-7e25-4646-bbb7-99d3a25e804f service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:31.846919 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-51d30e32-fe44-4227-b43e-8f9555e53bb1 req-23d196a0-7e25-4646-bbb7-99d3a25e804f service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:31.847488 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-51d30e32-fe44-4227-b43e-8f9555e53bb1 req-23d196a0-7e25-4646-bbb7-99d3a25e804f service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:31.861904 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-51d30e32-fe44-4227-b43e-8f9555e53bb1 req-23d196a0-7e25-4646-bbb7-99d3a25e804f service nova] Creating event network-vif-deleted:2bd2985e-d3fc-45a4-a290-2e60bb7e6f6d for instance d25af614-f5f9-426d-b95e-b13786d5a2ec on hv-cinder-84914 Oct 12 00:28:31.866889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-51d30e32-fe44-4227-b43e-8f9555e53bb1 req-23d196a0-7e25-4646-bbb7-99d3a25e804f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035770 Oct 12 00:28:31.867715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 502/1002] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:28:32.396561 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:32.397174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:32.403600 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:32.404089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:32.404548 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:32.405215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:32.405669 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:32.406096 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:32.467029 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:32.474787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0e10f1db-9073-4965-80d4-b7a6605c9f81 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1427 microversion: 2.1 time: 0.082432 Oct 12 00:28:32.475347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 501/1003] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:32 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:32.764400 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:32.765027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:32.771483 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:32.771964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:32.780295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:32.780295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:32.780295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:32.780295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:32.903772 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:32.911877 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:32.913313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:32.914502 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ed88e348-5565-4e7f-8996-884ff0ad8e99 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1723 microversion: 2.20 time: 0.154978 Oct 12 00:28:32.915058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 503/1004] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:28:32 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:28:33.498994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:33.499629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:33.506138 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:33.506316 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:33.506713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:33.508016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:33.508016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:33.508283 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:33.555475 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:33.555964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:33.557053 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:33.561268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lazy-loading 'fault' on Instance uuid d25af614-f5f9-426d-b95e-b13786d5a2ec {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:28:33.641305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0579e56a0b0b434389706f8f0b236ce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c1e5e7db4942dea48cd03d186bb033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:33.649304 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8ea2c610-4a5e-4346-9d3f-6000bbfbdf6d tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 200 len: 1303 microversion: 2.1 time: 0.154881 Oct 12 00:28:33.659406 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 502/1005] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:33 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:28:33.953208 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:33.959854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:33.966438 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:28:33.975162 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Wed Oct 12 00:28:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b (ip 10.222.0.36) !!! Oct 12 00:28:33.986990 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:33.987513 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:33.987990 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:33.988705 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:33.989163 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:33.989594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:34.056144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:34.065260 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:34.067004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:34.068263 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e36c921a-0bbc-42df-a627-fcbf41f8d5f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1655 microversion: 2.20 time: 0.125323 Oct 12 00:28:34.069034 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 504/1006] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:28:33 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1655 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:28:34.222980 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-1120edbd-8c7c-40a2-8059-b95b9b301317 req-aef26d4f-1629-4f22-af44-d20bc672917c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "facea60e-d753-4eda-b9f7-932b0cf5a63b", "name": "network-vif-deleted", "tag": "ff37e4cb-00cf-4bd1-b77a-3dffa69e456e"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:28:34.233591 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1120edbd-8c7c-40a2-8059-b95b9b301317 req-aef26d4f-1629-4f22-af44-d20bc672917c service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:34.234071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1120edbd-8c7c-40a2-8059-b95b9b301317 req-aef26d4f-1629-4f22-af44-d20bc672917c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:34.234500 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-1120edbd-8c7c-40a2-8059-b95b9b301317 req-aef26d4f-1629-4f22-af44-d20bc672917c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:34.245994 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-1120edbd-8c7c-40a2-8059-b95b9b301317 req-aef26d4f-1629-4f22-af44-d20bc672917c service nova] Creating event network-vif-deleted:ff37e4cb-00cf-4bd1-b77a-3dffa69e456e for instance facea60e-d753-4eda-b9f7-932b0cf5a63b on hv-cinder-84914 Oct 12 00:28:34.251111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-1120edbd-8c7c-40a2-8059-b95b9b301317 req-aef26d4f-1629-4f22-af44-d20bc672917c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032091 Oct 12 00:28:34.251761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 503/1007] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:28:34.672378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:34.673121 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] [instance: d25af614-f5f9-426d-b95e-b13786d5a2ec] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:34.680338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:34.680823 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:34.683512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:34.683512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:34.683512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:34.683512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:34.696784 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] HTTP exception thrown: Instance d25af614-f5f9-426d-b95e-b13786d5a2ec could not be found. Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Request method failure captured: Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec HTTP/1.1 Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgobz-9ZYa6Y9XaNKW1Um2uPNxe80OMclGNraotr1EwQGzGOTyPYivKl2NGva9yUzDtgSYMR7Hui-7lmKpv92QmXjTF4snlujj3bbLkQulnWn-EdMGwQSUti5ca3hJonXei2k8bebmP-YnYEHcnud6kmtM_JIvix_p5YLk73LI9BIUE Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 90c1e5e7db4942dea48cd03d186bb033 Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesNegativeTest-1136130521 Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:28:34.699334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_90c1e5e7db4942dea48cd03d186bb033", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90c1e5e7db4942dea48cd03d186bb033"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/90c1e5e7db4942dea48cd03d186bb033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/90c1e5e7db4942dea48cd03d186bb033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesNegativeTest-1136130521 Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 90c1e5e7db4942dea48cd03d186bb033 Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesNegativeTest-1136130521 Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesNegativeTest-1136130521-project Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: 0579e56a0b0b434389706f8f0b236ce3 Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesNegativeTest-1136130521-project Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance d25af614-f5f9-426d-b95e-b13786d5a2ec could not be found. Oct 12 00:28:34.700864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'd25af614-f5f9-426d-b95e-b13786d5a2ec'} Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d25af614-f5f9-426d-b95e-b13786d5a2ec could not be found. Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:28:34.701703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d25af614-f5f9-426d-b95e-b13786d5a2ec could not be found. Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d25af614-f5f9-426d-b95e-b13786d5a2ec could not be found. Oct 12 00:28:34.703022 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:34.704209 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] Returning 404 to user: Instance d25af614-f5f9-426d-b95e-b13786d5a2ec could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:28:34.704209 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6019a087-a5bf-46f5-be96-9b658408da32 tempest-VolumesNegativeTest-1136130521 tempest-VolumesNegativeTest-1136130521-project] 10.222.0.36 "GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec" status: 404 len: 111 microversion: 2.1 time: 0.032387 Oct 12 00:28:34.706560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 505/1008] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:28:34 2022] GET /compute/v2.1/servers/d25af614-f5f9-426d-b95e-b13786d5a2ec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 00:28:35.097421 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:35.100330 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:35.108144 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:35.109042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:35.109638 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:35.110691 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:35.111328 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:35.111777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:35.148667 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:35.149151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:35.149581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:35.151507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lazy-loading 'fault' on Instance uuid facea60e-d753-4eda-b9f7-932b0cf5a63b {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:28:35.210657 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:35.219216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:35.225066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '63474c55edbf4b22ad609471a2414ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bdb0f5c58a40af9e420f6072f2f2b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:28:35.225066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-73769aa7-a408-4245-a7a6-dd8a13c11706 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 200 len: 1371 microversion: 2.20 time: 0.131907 Oct 12 00:28:35.225066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 504/1009] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:28:35 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 00:28:36.251263 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:36.251975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:36.272793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:36.272793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:36.272793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:36.272793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:36.273433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:36.273433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:36.288295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] HTTP exception thrown: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Request method failure captured: Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b HTTP/1.1 Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgiIEbMiJg3ogRMpV1-1lkSVQOn1EhxHbHZHnEhLpuNw9tgauWu59f0I3Y3MBKh4CgHrUW78sqaxHF8BKard7kIZ6mnU6F23G7Ggb9mP8z165NyMlli4RL3WZslxFFxVQeHqI27DEp7dP_HhN3YAKYqZ1tm8RN8jT-p5HHkZF1j4mjk Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:28:36.290057 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bdb0f5c58a40af9e420f6072f2f2b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: 63474c55edbf4b22ad609471a2414ede Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:36.291820 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'facea60e-d753-4eda-b9f7-932b0cf5a63b'} Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:28:36.293236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:36.294648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:36.301701 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Returning 404 to user: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:28:36.301701 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2e954ed5-3b99-4fa8-9770-20559266046d tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 404 len: 111 microversion: 2.20 time: 0.054615 Oct 12 00:28:36.301701 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 506/1010] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:28:36 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:28:36.307206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8234f159-5f5a-4294-97a5-c0e1ace0b8f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '.version_select at 0x7f2fe8d29280>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:36.405275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8234f159-5f5a-4294-97a5-c0e1ace0b8f9 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299954300" status: 204 len: 0 microversion: 2.20 time: 0.101851 Oct 12 00:28:36.405862 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 505/1011] 10.222.0.36 () {60 vars in 1259 bytes} [Wed Oct 12 00:28:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299954300 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 00:28:38.443441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:38.444030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:38.450838 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:38.451319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:38.451773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:38.452468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:38.452976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:38.453458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:38.466927 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] HTTP exception thrown: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Request method failure captured: Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b HTTP/1.1 Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgiIEbMiJg3ogRMpV1-1lkSVQOn1EhxHbHZHnEhLpuNw9tgauWu59f0I3Y3MBKh4CgHrUW78sqaxHF8BKard7kIZ6mnU6F23G7Ggb9mP8z165NyMlli4RL3WZslxFFxVQeHqI27DEp7dP_HhN3YAKYqZ1tm8RN8jT-p5HHkZF1j4mjk Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:28:38.468504 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bdb0f5c58a40af9e420f6072f2f2b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: 63474c55edbf4b22ad609471a2414ede Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.470212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'facea60e-d753-4eda-b9f7-932b0cf5a63b'} Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:28:38.475096 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.476341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.477527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Returning 404 to user: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:28:38.477527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-06f113f7-2dcc-4980-aefa-de6e68fbec89 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "DELETE /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 404 len: 111 microversion: 2.20 time: 0.030478 Oct 12 00:28:38.477527 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 507/1012] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Oct 12 00:28:38 2022] DELETE /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:28:38.480640 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:38.481248 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: facea60e-d753-4eda-b9f7-932b0cf5a63b] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:38.488159 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:38.488642 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:38.489075 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:38.489769 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:38.490219 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:38.490642 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:38.506482 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] HTTP exception thrown: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Request method failure captured: Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b HTTP/1.1 Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgiIEbMiJg3ogRMpV1-1lkSVQOn1EhxHbHZHnEhLpuNw9tgauWu59f0I3Y3MBKh4CgHrUW78sqaxHF8BKard7kIZ6mnU6F23G7Ggb9mP8z165NyMlli4RL3WZslxFFxVQeHqI27DEp7dP_HhN3YAKYqZ1tm8RN8jT-p5HHkZF1j4mjk Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:28:38.509403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bdb0f5c58a40af9e420f6072f2f2b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: 63474c55edbf4b22ad609471a2414ede Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.511008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'facea60e-d753-4eda-b9f7-932b0cf5a63b'} Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:28:38.511844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. Oct 12 00:28:38.513134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:38.514210 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Returning 404 to user: Instance facea60e-d753-4eda-b9f7-932b0cf5a63b could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:28:38.514210 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7df6e32f-1f68-4371-b925-63d8dbb08888 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b" status: 404 len: 111 microversion: 2.20 time: 0.034374 Oct 12 00:28:38.514210 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 506/1013] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:28:38 2022] GET /compute/v2.1/servers/facea60e-d753-4eda-b9f7-932b0cf5a63b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:28:39.919088 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:39.919632 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:39.926140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:39.926623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:39.927055 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:39.927787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:39.928240 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:39.928683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:39.941992 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] HTTP exception thrown: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Request method failure captured: Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a HTTP/1.1 Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgiIEbMiJg3ogRMpV1-1lkSVQOn1EhxHbHZHnEhLpuNw9tgauWu59f0I3Y3MBKh4CgHrUW78sqaxHF8BKard7kIZ6mnU6F23G7Ggb9mP8z165NyMlli4RL3WZslxFFxVQeHqI27DEp7dP_HhN3YAKYqZ1tm8RN8jT-p5HHkZF1j4mjk Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:28:39.943574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bdb0f5c58a40af9e420f6072f2f2b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: 63474c55edbf4b22ad609471a2414ede Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.945346 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '90ce674c-f9e8-476b-b1e2-fe18ba36050a'} Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:28:39.946151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.947467 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.949254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Returning 404 to user: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:28:39.949254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a413df4d-0c0e-4881-b831-f8b016ac380b tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 404 len: 111 microversion: 2.20 time: 0.029689 Oct 12 00:28:39.949254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 508/1014] 10.222.0.36 () {60 vars in 1280 bytes} [Wed Oct 12 00:28:39 2022] DELETE /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:28:39.954395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:28:39.955005 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] [instance: 90ce674c-f9e8-476b-b1e2-fe18ba36050a] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:28:39.961493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:39.961983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:39.962414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:39.963108 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:28:39.963590 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:28:39.964014 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:28:39.977789 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] HTTP exception thrown: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Request method failure captured: Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a HTTP/1.1 Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgiIEbMiJg3ogRMpV1-1lkSVQOn1EhxHbHZHnEhLpuNw9tgauWu59f0I3Y3MBKh4CgHrUW78sqaxHF8BKard7kIZ6mnU6F23G7Ggb9mP8z165NyMlli4RL3WZslxFFxVQeHqI27DEp7dP_HhN3YAKYqZ1tm8RN8jT-p5HHkZF1j4mjk Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:28:39.979305 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_13bdb0f5c58a40af9e420f6072f2f2b0", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/13bdb0f5c58a40af9e420f6072f2f2b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 13bdb0f5c58a40af9e420f6072f2f2b0 Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-138744819 Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: 63474c55edbf4b22ad609471a2414ede Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-AttachVolumeShelveTestJSON-138744819-project Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.981033 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': '90ce674c-f9e8-476b-b1e2-fe18ba36050a'} Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:28:39.981947 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. Oct 12 00:28:39.983245 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:28:39.984618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] Returning 404 to user: Instance 90ce674c-f9e8-476b-b1e2-fe18ba36050a could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:28:39.984618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-931cf751-6982-4a9e-8444-8ebce98a4220 tempest-AttachVolumeShelveTestJSON-138744819 tempest-AttachVolumeShelveTestJSON-138744819-project] 10.222.0.36 "GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a" status: 404 len: 111 microversion: 2.20 time: 0.030515 Oct 12 00:28:39.984618 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 507/1015] 10.222.0.36 () {60 vars in 1277 bytes} [Wed Oct 12 00:28:39 2022] GET /compute/v2.1/servers/90ce674c-f9e8-476b-b1e2-fe18ba36050a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 00:29:15.512578 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2014073290", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "networks": [{"uuid": "fa19a090-fb71-4feb-a647-6b66897bc28c"}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:29:15.521429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:15.522210 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:15.568964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] validate_networks() for [('fa19a090-fb71-4feb-a647-6b66897bc28c', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:29:15.910508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:29:15.910924 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:29:15.911439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:29:15.911842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:29:15.912278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:29:15.921056 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:15.921469 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:15.921890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:15.922600 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:15.923042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:15.923489 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:15.939565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Getting quotas for project cdece90b26c74eb89113d317b1609e92. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:29:15.943813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Getting quotas for user c1ed99c8700a49bbb9ef9d4a13515c17 and project cdece90b26c74eb89113d317b1609e92. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:29:15.955341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:29:15.957608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:29:16.081879 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b036ff30-9ba3-4dd6-8e05-cb08761b7b99 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573150 Oct 12 00:29:16.082515 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 509/1016] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:29:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:29:16.093688 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-19aa4485-662f-4832-ab6f-98566ce614a7 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:16.098188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-19aa4485-662f-4832-ab6f-98566ce614a7 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:16.098188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:16.098188 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:16.149363 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-19aa4485-662f-4832-ab6f-98566ce614a7 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:16.156831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-19aa4485-662f-4832-ab6f-98566ce614a7 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1214 microversion: 2.1 time: 0.066938 Oct 12 00:29:16.158196 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 508/1017] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:16 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:17.180024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:17.180625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:17.188239 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:17.188761 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:17.189688 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:17.190415 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:17.190898 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:17.191324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:17.251145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:17.259397 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-62717105-0451-4b49-a3d1-6e5797452417 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1218 microversion: 2.1 time: 0.083223 Oct 12 00:29:17.259952 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 510/1018] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:17 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:18.282066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:18.282616 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:18.291910 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:18.292399 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:18.292824 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:18.293513 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:18.293966 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:18.294390 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:18.356353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:18.364124 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f64eb290-c45f-409e-ba05-454e0b30c6cd tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1266 microversion: 2.1 time: 0.085971 Oct 12 00:29:18.364685 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 509/1019] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:18 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:19.387328 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:19.387942 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:19.394337 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:19.394837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:19.395458 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:19.396281 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:19.396745 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:19.397174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:19.463622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:19.471903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7109f7f4-93bf-48fb-9205-ef8c6fa72cda tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1272 microversion: 2.1 time: 0.088689 Oct 12 00:29:19.472480 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 511/1020] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:19 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:20.495096 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:20.495735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:20.502874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:20.503357 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:20.503815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:20.504508 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:20.504952 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:20.505374 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:20.681542 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:20.689149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bd7dc238-203f-4669-b9b2-b02c0682a0e2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.198689 Oct 12 00:29:20.689714 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 510/1021] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:20 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:20.775405 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-a304fe95-515c-4cd3-a6bf-d9661ac929e3 req-115ba4d7-6ed0-4e2a-9827-f6636be1d548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "353c1661-6e48-43fe-9d08-208d229bafbf", "tag": "4320d110-51ef-454f-ae13-6218c4debbf9"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:29:20.786073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a304fe95-515c-4cd3-a6bf-d9661ac929e3 req-115ba4d7-6ed0-4e2a-9827-f6636be1d548 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:20.786653 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a304fe95-515c-4cd3-a6bf-d9661ac929e3 req-115ba4d7-6ed0-4e2a-9827-f6636be1d548 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:20.787158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a304fe95-515c-4cd3-a6bf-d9661ac929e3 req-115ba4d7-6ed0-4e2a-9827-f6636be1d548 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:20.798315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-a304fe95-515c-4cd3-a6bf-d9661ac929e3 req-115ba4d7-6ed0-4e2a-9827-f6636be1d548 service nova] Creating event network-changed:4320d110-51ef-454f-ae13-6218c4debbf9 for instance 353c1661-6e48-43fe-9d08-208d229bafbf on hv-cinder-84914 Oct 12 00:29:20.803818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-a304fe95-515c-4cd3-a6bf-d9661ac929e3 req-115ba4d7-6ed0-4e2a-9827-f6636be1d548 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032140 Oct 12 00:29:20.804410 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 512/1022] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:29:21.711838 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:21.712454 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:21.719889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:21.721027 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:21.721474 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:21.722169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:21.722626 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:21.723050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:21.857398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:21.870556 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b4c8eea2-2d7a-47b9-8a85-4fe3fe751907 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.158011 Oct 12 00:29:21.870556 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 511/1023] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:21 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:22.891967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:22.893282 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:22.899735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:22.900216 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:22.900647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:22.901338 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:22.901814 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:22.902238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:23.031217 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:23.038883 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b7d65028-00c7-4adb-8a0e-a489ee17c1d2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.151684 Oct 12 00:29:23.039456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 513/1024] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:22 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:24.063613 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:24.064137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:24.070535 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:24.071018 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:24.071484 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:24.072179 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:24.072631 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:24.073057 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:24.198060 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:24.206184 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7472771a-8283-492f-8015-00c81d687213 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.146534 Oct 12 00:29:24.206745 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 512/1025] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:24 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:25.228792 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:25.229403 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:25.236502 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:25.236974 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:25.237398 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:25.238085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:25.238526 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:25.238936 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:25.364787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:25.372847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-35ee9e89-4ab1-4adc-8258-6146b87ff868 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.148270 Oct 12 00:29:25.376062 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 514/1026] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:25 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:26.395176 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:26.395902 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:26.398220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:26.403143 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:26.403649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:26.404265 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:26.404955 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:26.405464 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:26.405803 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:26.558452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:26.566870 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8a93a792-4580-4d1e-8bdf-6dd44dd6b88e tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.175713 Oct 12 00:29:26.567450 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 513/1027] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:26 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:27.589507 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:27.590139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:27.592103 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:27.592794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:27.598039 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:27.598514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:27.598955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:27.599670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:27.600113 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:27.600528 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:27.732045 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:27.740265 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9e2db6aa-2b35-40f9-9cc3-0827f6fff046 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.154648 Oct 12 00:29:27.740832 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 515/1028] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:27 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:28.763353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:28.764022 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:28.771134 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:28.771633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:28.772074 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:28.772807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:28.773242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:28.773665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:28.902606 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:28.910254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-fffaf972-4305-466a-958f-ef0689132c3f tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.150961 Oct 12 00:29:28.910813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 514/1029] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:28 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:29.071350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-14be58bc-3a2d-49dd-88ef-e41d4cac285f req-313950ef-ceca-4a2f-9fb0-50b467ef8571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353c1661-6e48-43fe-9d08-208d229bafbf", "name": "network-vif-plugged", "status": "completed", "tag": "4320d110-51ef-454f-ae13-6218c4debbf9"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:29:29.082747 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-14be58bc-3a2d-49dd-88ef-e41d4cac285f req-313950ef-ceca-4a2f-9fb0-50b467ef8571 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:29.083259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-14be58bc-3a2d-49dd-88ef-e41d4cac285f req-313950ef-ceca-4a2f-9fb0-50b467ef8571 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:29.083723 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-14be58bc-3a2d-49dd-88ef-e41d4cac285f req-313950ef-ceca-4a2f-9fb0-50b467ef8571 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:29.094537 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-14be58bc-3a2d-49dd-88ef-e41d4cac285f req-313950ef-ceca-4a2f-9fb0-50b467ef8571 service nova] Creating event network-vif-plugged:4320d110-51ef-454f-ae13-6218c4debbf9 for instance 353c1661-6e48-43fe-9d08-208d229bafbf on hv-cinder-84914 Oct 12 00:29:29.099536 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-14be58bc-3a2d-49dd-88ef-e41d4cac285f req-313950ef-ceca-4a2f-9fb0-50b467ef8571 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031768 Oct 12 00:29:29.100052 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 516/1030] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:29:29.932538 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:29.933068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:29.939599 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:29.940085 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:29.940529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:29.941215 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:29.941674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:29.942101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:30.071725 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:30.079461 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-29a652b1-856a-49ad-b83e-65cd7e10ce55 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1314 microversion: 2.1 time: 0.150879 Oct 12 00:29:30.080028 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 515/1031] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:29 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:29:31.103683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:31.104432 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:31.110629 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:31.111168 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:31.111611 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:31.112793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:31.113246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:31.113668 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:31.248106 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:31.256287 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b3568013-f93d-4748-9652-656be782d6cf tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1498 microversion: 2.1 time: 0.157360 Oct 12 00:29:31.256865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 517/1032] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:31 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:32.272635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:32.273257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:32.280087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:32.280574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:32.281007 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:32.281788 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:32.282242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:32.282665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:32.310104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:29:32.586267 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-16292371-b149-48cd-a753-01b2dee8a50d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "DELETE /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 204 len: 0 microversion: 2.1 time: 0.317419 Oct 12 00:29:32.586874 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 516/1033] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:29:32 2022] DELETE /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:29:32.596800 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:32.597489 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:32.603953 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:32.604648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:32.605077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:32.605787 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:32.606214 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:32.606633 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:32.739932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:32.747956 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c16585f3-eb96-4c96-be22-0231b02e5861 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1504 microversion: 2.1 time: 0.156354 Oct 12 00:29:32.748511 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 518/1034] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:32 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:33.772016 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:33.772714 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:33.779153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:33.779659 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:33.780090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:33.780773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:33.781222 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:33.781642 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:33.915008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:33.922645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-86345698-e39d-40c5-9a6b-80b5f6c94414 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1504 microversion: 2.1 time: 0.155193 Oct 12 00:29:33.923201 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 517/1035] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:33 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:34.721212 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-ce3ade75-ea8c-4297-90d9-2efc3af5646d req-471a6e91-c63a-4437-bd82-b3a1392af35a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "353c1661-6e48-43fe-9d08-208d229bafbf", "name": "network-vif-deleted", "tag": "4320d110-51ef-454f-ae13-6218c4debbf9"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:29:34.731082 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ce3ade75-ea8c-4297-90d9-2efc3af5646d req-471a6e91-c63a-4437-bd82-b3a1392af35a service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:34.731608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ce3ade75-ea8c-4297-90d9-2efc3af5646d req-471a6e91-c63a-4437-bd82-b3a1392af35a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:34.732172 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ce3ade75-ea8c-4297-90d9-2efc3af5646d req-471a6e91-c63a-4437-bd82-b3a1392af35a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:34.743617 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-ce3ade75-ea8c-4297-90d9-2efc3af5646d req-471a6e91-c63a-4437-bd82-b3a1392af35a service nova] Creating event network-vif-deleted:4320d110-51ef-454f-ae13-6218c4debbf9 for instance 353c1661-6e48-43fe-9d08-208d229bafbf on hv-cinder-84914 Oct 12 00:29:34.748431 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-ce3ade75-ea8c-4297-90d9-2efc3af5646d req-471a6e91-c63a-4437-bd82-b3a1392af35a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031050 Oct 12 00:29:34.749015 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 519/1036] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:29:34.945815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:34.946434 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:34.952981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:34.953465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:34.956770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:34.956770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:34.956770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:34.956770 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:35.021912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:35.030369 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-12bb45ce-3c2f-4a63-8492-35e0d5114d34 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 200 len: 1299 microversion: 2.1 time: 0.088553 Oct 12 00:29:35.030971 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 518/1037] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:34 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:36.056519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:36.057138 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: 353c1661-6e48-43fe-9d08-208d229bafbf] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:36.063630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:36.064105 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:36.064530 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:36.065213 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:36.065793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:36.066749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:36.080049 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] HTTP exception thrown: Instance 353c1661-6e48-43fe-9d08-208d229bafbf could not be found. Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Request method failure captured: Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf HTTP/1.1 Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgpZPeyYGWjd9BsxMIiARtiuq3DYyPNTxZmj6mPi2YzAA0HtjvPc-3roXjTod2Np8BBIEUOFjStapwO9xuHkBqJ2W0v7A8ttULedtOoPdQv71likX1gC9M1z4dwdcobxLfVia2D7KvlJl7XrBUH9fKuTcm7RoRoOqjp9l_U6XCGpNuk Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: cdece90b26c74eb89113d317b1609e92 Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesActionsTest-481233233 Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:29:36.081699 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cdece90b26c74eb89113d317b1609e92", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cdece90b26c74eb89113d317b1609e92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cdece90b26c74eb89113d317b1609e92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cdece90b26c74eb89113d317b1609e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesActionsTest-481233233 Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: cdece90b26c74eb89113d317b1609e92 Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesActionsTest-481233233 Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesActionsTest-481233233-project Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: c1ed99c8700a49bbb9ef9d4a13515c17 Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesActionsTest-481233233-project Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance 353c1661-6e48-43fe-9d08-208d229bafbf could not be found. Oct 12 00:29:36.083512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': '353c1661-6e48-43fe-9d08-208d229bafbf'} Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 353c1661-6e48-43fe-9d08-208d229bafbf could not be found. Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:29:36.084531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 353c1661-6e48-43fe-9d08-208d229bafbf could not be found. Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 353c1661-6e48-43fe-9d08-208d229bafbf could not be found. Oct 12 00:29:36.086418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:29:36.088847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Returning 404 to user: Instance 353c1661-6e48-43fe-9d08-208d229bafbf could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:29:36.088847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-19fb4859-2c05-4616-ac06-40f925ec32b2 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf" status: 404 len: 111 microversion: 2.1 time: 0.033308 Oct 12 00:29:36.088847 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 520/1038] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:36 2022] GET /compute/v2.1/servers/353c1661-6e48-43fe-9d08-208d229bafbf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:29:36.180611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1109618043", "imageRef": "845e342f-850d-46be-8936-6861d6742fe6", "flavorRef": "452", "networks": [{"uuid": "fa19a090-fb71-4feb-a647-6b66897bc28c"}]}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:29:36.233256 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] validate_networks() for [('fa19a090-fb71-4feb-a647-6b66897bc28c', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:29:36.825625 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:29:36.826137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:29:36.826635 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:29:36.831971 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:29:36.831971 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:29:36.837181 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:36.837643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:36.838071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:36.838790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:36.839236 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:36.839707 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:36.856653 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Getting quotas for project cdece90b26c74eb89113d317b1609e92. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:29:36.860593 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Getting quotas for user c1ed99c8700a49bbb9ef9d4a13515c17 and project cdece90b26c74eb89113d317b1609e92. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:29:36.871705 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:29:36.873990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='845e342f-850d-46be-8936-6861d6742fe6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:29:37.062984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-885b11e9-7522-416a-951a-6d8ded60ea94 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886025 Oct 12 00:29:37.063677 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 519/1039] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 00:29:37.075134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e8cd8702-d8c9-4ad3-a9d4-89ad25ea0110 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:37.076116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e8cd8702-d8c9-4ad3-a9d4-89ad25ea0110 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:37.132296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e8cd8702-d8c9-4ad3-a9d4-89ad25ea0110 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:37.140114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e8cd8702-d8c9-4ad3-a9d4-89ad25ea0110 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1214 microversion: 2.1 time: 0.068843 Oct 12 00:29:37.140682 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 521/1040] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:37 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:38.165086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:38.165656 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:38.172909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:38.173386 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:38.173813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:38.174506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:38.174953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:38.175513 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:38.239104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:38.247997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-142853d8-6f70-47d3-bded-89736ed72a1a tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1218 microversion: 2.1 time: 0.087303 Oct 12 00:29:38.248717 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 520/1041] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:38 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:39.272781 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:39.273329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:39.279966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:39.280448 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:39.280966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:39.282114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:39.282565 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:39.283184 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:39.351132 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:39.359278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bd696266-4a4e-447d-a022-8f8a3f2d8596 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1274 microversion: 2.1 time: 0.091704 Oct 12 00:29:39.359930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 522/1042] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:39 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:40.382522 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:40.383823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:40.391253 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:40.391852 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:40.392349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:40.393129 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:40.393577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:40.394908 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:40.574729 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:40.582882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a8377d1d-d870-42cd-8633-86922ebcd692 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1314 microversion: 2.1 time: 0.204802 Oct 12 00:29:40.583457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 521/1043] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:40 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:41.002180 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-1ef79ca8-bf7f-4422-9d5f-af8f1e913a75 req-648e42db-0ca4-4224-9327-5c634eabd171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66ebd2e-eed9-46cc-b9b9-c1fbc022b173", "tag": "07107ec5-078d-407b-863d-2b18051afa41"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:29:41.012751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1ef79ca8-bf7f-4422-9d5f-af8f1e913a75 req-648e42db-0ca4-4224-9327-5c634eabd171 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:41.013225 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1ef79ca8-bf7f-4422-9d5f-af8f1e913a75 req-648e42db-0ca4-4224-9327-5c634eabd171 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:41.013648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1ef79ca8-bf7f-4422-9d5f-af8f1e913a75 req-648e42db-0ca4-4224-9327-5c634eabd171 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:41.027351 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-1ef79ca8-bf7f-4422-9d5f-af8f1e913a75 req-648e42db-0ca4-4224-9327-5c634eabd171 service nova] Creating event network-changed:07107ec5-078d-407b-863d-2b18051afa41 for instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 on hv-cinder-84914 Oct 12 00:29:41.032024 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-1ef79ca8-bf7f-4422-9d5f-af8f1e913a75 req-648e42db-0ca4-4224-9327-5c634eabd171 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033531 Oct 12 00:29:41.032628 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 523/1044] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:29:41.607166 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:41.607933 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:41.615049 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:41.615578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:41.616015 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:41.616703 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:41.617155 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:41.617579 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:41.834110 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:41.841730 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a4e126c7-d85d-4bd7-827c-1f8f910a98f3 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1314 microversion: 2.1 time: 0.238402 Oct 12 00:29:41.842483 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 522/1045] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:41 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:42.867023 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:42.867729 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:42.873837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:42.874311 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:42.874733 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:42.875481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:42.875925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:42.876343 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:43.007495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:43.015944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8aaa0a58-85ab-4317-9dfb-370a1a2f34e4 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1314 microversion: 2.1 time: 0.154095 Oct 12 00:29:43.016525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 524/1046] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:42 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:44.038998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:44.039643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:44.046020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:44.046487 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:44.046911 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:44.047611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:44.048058 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:44.048475 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:44.181307 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:44.189439 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5fc10b3e-62e4-435a-b049-9597516b37e9 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1314 microversion: 2.1 time: 0.154335 Oct 12 00:29:44.190007 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 523/1047] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:44 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:45.213002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:45.213780 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:45.220380 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:45.220864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:45.221295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:45.221996 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:45.222448 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:45.222881 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:45.352871 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:45.360535 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-819aba4f-b8a8-46b8-be68-19c605691753 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1314 microversion: 2.1 time: 0.151928 Oct 12 00:29:45.361265 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 525/1048] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:45 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:46.384367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:46.384950 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:46.391596 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:46.392071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:46.392497 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:46.393186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:46.393629 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:46.394045 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:46.412164 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:46.523685 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:46.531089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ceaf3d32-2203-4b8d-a7e1-8b436c295cd6 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1314 microversion: 2.1 time: 0.150643 Oct 12 00:29:46.531671 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 524/1049] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:46 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:47.079036 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-8b9a02cd-add3-46ff-b075-edde435eee31 req-5cef963f-4a4b-44f7-85b5-5b8020b74e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66ebd2e-eed9-46cc-b9b9-c1fbc022b173", "name": "network-vif-plugged", "status": "completed", "tag": "07107ec5-078d-407b-863d-2b18051afa41"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:29:47.084967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:47.089974 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8b9a02cd-add3-46ff-b075-edde435eee31 req-5cef963f-4a4b-44f7-85b5-5b8020b74e82 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:47.090457 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8b9a02cd-add3-46ff-b075-edde435eee31 req-5cef963f-4a4b-44f7-85b5-5b8020b74e82 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:47.090925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8b9a02cd-add3-46ff-b075-edde435eee31 req-5cef963f-4a4b-44f7-85b5-5b8020b74e82 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:47.094495 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=73 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:47.103236 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-8b9a02cd-add3-46ff-b075-edde435eee31 req-5cef963f-4a4b-44f7-85b5-5b8020b74e82 service nova] Creating event network-vif-plugged:07107ec5-078d-407b-863d-2b18051afa41 for instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 on hv-cinder-84914 Oct 12 00:29:47.109104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-8b9a02cd-add3-46ff-b075-edde435eee31 req-5cef963f-4a4b-44f7-85b5-5b8020b74e82 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033736 Oct 12 00:29:47.109717 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 526/1050] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:29:47.553496 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:47.554199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:47.556031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:47.556693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=6 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:47.561864 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:47.562383 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:47.573349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:47.573349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:47.573349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:47.573349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:47.698076 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:47.706523 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-97f8b6fc-42f2-4d78-b3df-2486b8892c70 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1314 microversion: 2.1 time: 0.156864 Oct 12 00:29:47.707095 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 525/1051] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:47 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:48.726715 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:48.731679 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:48.732380 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:48.739716 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:48.740203 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:48.740638 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:48.741337 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:48.741793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:48.742211 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:48.878643 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:48.886309 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ad067a13-1e3e-4b4d-a257-fd3f3ebebd1b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1314 microversion: 2.1 time: 0.161182 Oct 12 00:29:48.886872 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 527/1052] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:48 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:49.909111 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:49.909714 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:49.915790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:49.916263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:49.916692 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:49.917375 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:49.917827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:49.918247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:50.044089 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:50.051617 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bf08d692-4c65-445a-b300-47cbb26d648c tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1498 microversion: 2.1 time: 0.146584 Oct 12 00:29:50.052181 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 526/1053] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:49 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:51.137280 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:51.137782 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:51.143897 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:51.144378 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:51.145063 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:51.145749 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:51.146199 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:51.146622 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:51.171893 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:29:51.443246 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-18ce232d-50d5-4aa2-a9b7-364a8e89f745 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 204 len: 0 microversion: 2.1 time: 0.309396 Oct 12 00:29:51.443797 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 528/1054] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:29:51 2022] DELETE /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:29:51.452286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:51.452894 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:51.455178 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:29:51.459854 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:51.460410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:51.460847 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:51.461539 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:51.461988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:51.462408 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:51.593002 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:51.601249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b6f1bb60-12b9-4399-bd7f-88832ab55289 tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1504 microversion: 2.1 time: 0.152176 Oct 12 00:29:51.601820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 527/1055] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:51 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:52.623799 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:52.624493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:52.631137 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:52.631646 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:52.632075 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:52.632751 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:52.633198 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:52.633613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:52.760077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:52.767794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b6043f3d-24ea-4298-be20-669312fed91d tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1504 microversion: 2.1 time: 0.148122 Oct 12 00:29:52.768369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 529/1056] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:52 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:53.716940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-77345a83-3e67-493e-b361-2819724f5355 req-154b593e-4b94-462b-99c6-3c1934542bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66ebd2e-eed9-46cc-b9b9-c1fbc022b173", "name": "network-vif-deleted", "tag": "07107ec5-078d-407b-863d-2b18051afa41"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:29:53.728168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-77345a83-3e67-493e-b361-2819724f5355 req-154b593e-4b94-462b-99c6-3c1934542bdb service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:53.728639 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-77345a83-3e67-493e-b361-2819724f5355 req-154b593e-4b94-462b-99c6-3c1934542bdb service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:53.729079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-77345a83-3e67-493e-b361-2819724f5355 req-154b593e-4b94-462b-99c6-3c1934542bdb service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:53.740031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-77345a83-3e67-493e-b361-2819724f5355 req-154b593e-4b94-462b-99c6-3c1934542bdb service nova] Creating event network-vif-deleted:07107ec5-078d-407b-863d-2b18051afa41 for instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 on hv-cinder-84914 Oct 12 00:29:53.746042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-77345a83-3e67-493e-b361-2819724f5355 req-154b593e-4b94-462b-99c6-3c1934542bdb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032947 Oct 12 00:29:53.746674 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 528/1057] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:29:53.792081 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:53.792727 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:53.799530 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:53.799939 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:53.800370 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:53.801077 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:53.801524 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:53.801946 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:53.866219 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1ed99c8700a49bbb9ef9d4a13515c17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdece90b26c74eb89113d317b1609e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:29:53.874181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-daa8505d-9904-425d-a280-ab5d120029fe tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 200 len: 1462 microversion: 2.1 time: 0.086606 Oct 12 00:29:53.874735 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 530/1058] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:53 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:29:54.898207 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:29:54.898904 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] [instance: c66ebd2e-eed9-46cc-b9b9-c1fbc022b173] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:29:54.905481 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:54.905960 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:54.906388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:54.907067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:29:54.907543 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:29:54.907972 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:29:54.922748 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] HTTP exception thrown: Instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 could not be found. Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Request method failure captured: Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 HTTP/1.1 Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgpZPeyYGWjd9BsxMIiARtiuq3DYyPNTxZmj6mPi2YzAA0HtjvPc-3roXjTod2Np8BBIEUOFjStapwO9xuHkBqJ2W0v7A8ttULedtOoPdQv71likX1gC9M1z4dwdcobxLfVia2D7KvlJl7XrBUH9fKuTcm7RoRoOqjp9l_U6XCGpNuk Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: cdece90b26c74eb89113d317b1609e92 Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-VolumesActionsTest-481233233 Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:29:54.924395 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_cdece90b26c74eb89113d317b1609e92", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cdece90b26c74eb89113d317b1609e92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/cdece90b26c74eb89113d317b1609e92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/cdece90b26c74eb89113d317b1609e92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-VolumesActionsTest-481233233 Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: cdece90b26c74eb89113d317b1609e92 Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-VolumesActionsTest-481233233 Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-VolumesActionsTest-481233233-project Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: c1ed99c8700a49bbb9ef9d4a13515c17 Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-VolumesActionsTest-481233233-project Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 could not be found. Oct 12 00:29:54.929263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'c66ebd2e-eed9-46cc-b9b9-c1fbc022b173'} Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 could not be found. Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:29:54.930239 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 could not be found. Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 could not be found. Oct 12 00:29:54.932515 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:29:54.934147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] Returning 404 to user: Instance c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:29:54.934147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-22807d2c-41a9-469f-8433-bd84be80df2b tempest-VolumesActionsTest-481233233 tempest-VolumesActionsTest-481233233-project] 10.222.0.36 "GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173" status: 404 len: 111 microversion: 2.1 time: 0.032298 Oct 12 00:29:54.934147 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 529/1059] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:29:54 2022] GET /compute/v2.1/servers/c66ebd2e-eed9-46cc-b9b9-c1fbc022b173 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:30:23.101127 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:30:23.101697 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:23.103825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:30:23.103971 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Wed Oct 12 00:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866/action (ip 10.222.0.36) !!! Oct 12 00:30:23.105452 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:30:23.106130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:30:23.112341 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:23.112826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:23.113253 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:23.113942 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:23.114501 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:23.114932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:23.143991 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lazy-loading 'flavor' on Instance uuid b23fd934-b03a-4259-8fd8-8dbcc42be866 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:30:23.384612 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-729c2954-b0ed-4029-b99f-765a39b247ee tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "POST /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866/action" status: 202 len: 0 microversion: 2.1 time: 0.287224 Oct 12 00:30:23.385124 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 531/1060] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:30:23 2022] POST /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:30:23.395732 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:23.396366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:23.398668 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=5 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:30:23.399337 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=24 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:30:23.405115 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:23.405599 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:23.406037 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:23.406800 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:23.407256 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:23.407725 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:23.751189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:23.763286 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5966f7f3-3a0d-4282-93ff-7134dedd5f0c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.373519 Oct 12 00:30:23.764262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 530/1061] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:23 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:24.790058 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:24.790767 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:24.800084 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:24.800705 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:24.801301 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:24.802399 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:24.802968 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:24.803639 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:25.167923 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:25.175624 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-13de8531-fbad-417b-8156-1f0e146f9146 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.391005 Oct 12 00:30:25.176183 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 532/1062] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:24 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:26.198608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:26.199201 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:26.205613 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:26.206086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:26.206517 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:26.207198 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:26.207668 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:26.208086 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:26.340549 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:26.348287 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-51b45616-ae74-41a8-a724-240c269118bd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.154114 Oct 12 00:30:26.348836 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 531/1063] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:26 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:27.371167 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:27.371659 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:27.378017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:27.378496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:27.378925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:27.379643 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:27.380097 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:27.380517 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:27.510525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:27.518720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6b47bdaf-a030-44ca-af94-37527e60124b tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.151723 Oct 12 00:30:27.519315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 533/1064] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:27 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:28.542099 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:28.542606 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:28.549529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:28.550001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:28.550425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:28.551106 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:28.551578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:28.551992 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:28.680225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:28.687803 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e0c646b7-3504-4ae5-971b-eb7ccf1e3e46 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.149613 Oct 12 00:30:28.688362 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 532/1065] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:28 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:30:29.710352 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:29.710997 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:29.717573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:29.717995 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:29.718430 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:29.719121 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:29.719602 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:29.720027 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:29.851796 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:29.860317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3ce6418a-3d65-493c-a5d8-b00298ffe935 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.153892 Oct 12 00:30:29.860903 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 534/1066] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:29 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:30.884388 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:30.885001 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:30.892104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:30.892585 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:30.893020 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:30.893711 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:30.894167 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:30.894591 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:31.025698 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:31.034258 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-8c17cdc7-448b-4d16-8ca2-0e3766644458 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.153726 Oct 12 00:30:31.045189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 533/1067] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:30 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:32.058957 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:32.066644 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:32.074337 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:32.075026 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:32.075497 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:32.076200 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:32.076658 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:32.077571 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:32.203671 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:32.211321 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2e531eb8-73de-4c8b-a322-e53b64990df6 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.156991 Oct 12 00:30:32.211912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 535/1068] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:32 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:33.234854 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:33.235577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:33.241986 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:33.242401 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:33.242832 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:33.243536 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:33.243981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:33.244397 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:33.375322 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:33.383209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-3b22fe2c-e752-4bb9-b9ca-e3e04f9f4c82 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.153095 Oct 12 00:30:33.383791 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 534/1069] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:33 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:34.406464 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:34.407061 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:34.414508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:34.414994 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:34.415452 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:34.416153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:34.416603 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:34.417030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:34.548909 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:34.556677 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4dbf75dd-9da7-4087-b312-e8f0d681f220 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.154002 Oct 12 00:30:34.557242 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 536/1070] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:34 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:35.579990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:35.580603 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:35.587150 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:35.587658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:35.588101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:35.588791 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:35.589247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:35.589675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:35.720446 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:35.728242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b55f972b-4974-407d-b7d1-fcc1266d3718 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.152090 Oct 12 00:30:35.728809 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 535/1071] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:35 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:36.751828 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:36.752471 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:36.758786 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:36.759265 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:36.759726 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:36.760455 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:36.760911 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:36.761332 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:36.897642 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:36.905796 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-45c154e6-a911-4e1a-b30e-c5cf44cf7332 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.158491 Oct 12 00:30:36.910958 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 537/1072] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:36 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:37.928844 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:37.929435 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:37.935704 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:37.936753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:37.937192 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:37.937875 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:37.938335 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:37.938736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:38.069589 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:38.077353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0feb7cc1-bdf8-4e17-8266-eca230514acb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1509 microversion: 2.1 time: 0.152399 Oct 12 00:30:38.077918 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 536/1073] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:37 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:38.099563 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:30:38.100159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:38.106529 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:38.106997 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:38.107439 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:38.108612 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:38.109094 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:38.109514 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:38.138047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125810) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 00:30:38.398665 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4c7d5932-dd25-42a6-9340-2df835234beb tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "POST /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866/action" status: 202 len: 0 microversion: 2.1 time: 0.303041 Oct 12 00:30:38.399196 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 538/1074] 10.222.0.36 () {60 vars in 1278 bytes} [Wed Oct 12 00:30:38 2022] POST /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:30:38.407636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:38.411906 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:38.414349 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:38.414831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:38.415263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:38.415984 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:38.416435 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:38.416857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:38.578865 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:38.586760 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1709b067-2063-400d-97fb-3c84e8bf237c tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1517 microversion: 2.1 time: 0.183354 Oct 12 00:30:38.587299 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 537/1075] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:38 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:39.611220 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:39.611860 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:39.617765 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:39.618242 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:39.618675 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:39.619375 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:39.619834 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:39.620254 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:39.751964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:39.759702 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a089332b-74e4-4693-9ee2-e7a308683f94 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1519 microversion: 2.1 time: 0.153286 Oct 12 00:30:39.760468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 539/1076] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:39 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:40.782444 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:40.783165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:40.790064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:40.790543 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:40.790980 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:40.791712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:40.792168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:40.792642 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:40.926689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:40.934802 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6ad5ecb4-62c4-4b07-af5d-f29f4bb7cca9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1519 microversion: 2.1 time: 0.156212 Oct 12 00:30:40.940805 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 538/1077] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:40 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:41.336678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-072b3730-6a8f-483e-a2b3-715217fc1180 req-afc92f49-16f2-4a2b-8f71-eea910f6d29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23fd934-b03a-4259-8fd8-8dbcc42be866", "name": "network-vif-unplugged", "status": "completed", "tag": "4ad8437d-d747-4320-afc4-1d72d58b1f96"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:30:41.347149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-072b3730-6a8f-483e-a2b3-715217fc1180 req-afc92f49-16f2-4a2b-8f71-eea910f6d29b service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:41.347663 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-072b3730-6a8f-483e-a2b3-715217fc1180 req-afc92f49-16f2-4a2b-8f71-eea910f6d29b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:41.348116 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-072b3730-6a8f-483e-a2b3-715217fc1180 req-afc92f49-16f2-4a2b-8f71-eea910f6d29b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:41.359418 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-072b3730-6a8f-483e-a2b3-715217fc1180 req-afc92f49-16f2-4a2b-8f71-eea910f6d29b service nova] Creating event network-vif-unplugged:4ad8437d-d747-4320-afc4-1d72d58b1f96 for instance b23fd934-b03a-4259-8fd8-8dbcc42be866 on hv-cinder-84914 Oct 12 00:30:41.364374 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-072b3730-6a8f-483e-a2b3-715217fc1180 req-afc92f49-16f2-4a2b-8f71-eea910f6d29b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031450 Oct 12 00:30:41.364951 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 540/1078] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:30:41.959655 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:41.960512 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:41.968277 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:41.968886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:41.969415 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:41.970238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:41.970921 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:41.971666 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:42.176425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:42.184381 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bf9933f6-86d5-4bcd-8b23-b46d11afa1cc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.228936 Oct 12 00:30:42.184956 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 539/1079] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:41 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:43.213498 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:43.214186 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:43.220370 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:43.220842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:43.221271 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:43.221948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:43.222395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:43.222809 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:43.353541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:43.361648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-170b182e-5844-4a1b-9199-b9fe1bae0d17 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.152864 Oct 12 00:30:43.362215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 541/1080] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:43 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:44.384989 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:44.385594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:44.392567 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:44.393043 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:44.393471 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:44.394157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:44.394601 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:44.395017 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:44.526093 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:44.533879 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-19204170-f342-4402-90b1-111d394e01a9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.152814 Oct 12 00:30:44.534439 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 540/1081] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:44 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:45.555856 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:45.556470 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:45.562960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:45.563475 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:45.563912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:45.564608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:45.565064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:45.565486 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:45.691930 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:45.699693 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d2b13aec-7a2f-49ea-9a33-8fa0a8c9a090 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.147643 Oct 12 00:30:45.700261 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 542/1082] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:45 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:46.723667 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:46.724281 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:46.730902 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:46.731413 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:46.731904 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:46.732594 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:46.733046 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:46.734109 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:46.869661 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:46.877347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f00cdd01-cfed-45b6-93a2-dd97a3c04ab8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.157709 Oct 12 00:30:46.877911 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 541/1083] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:46 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:47.900117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:47.901902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:47.907316 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:47.907824 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:47.908272 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:47.909007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:47.909460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:47.909888 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:48.054578 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:48.066044 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e47707bd-aebf-4a88-9016-4eb3c5c7bdbc tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.169822 Oct 12 00:30:48.066615 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 543/1084] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:47 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:49.088764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:49.089362 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:49.095745 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:49.096212 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:49.096649 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:49.097332 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:49.097786 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:49.098206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:49.229261 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:49.237592 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-aabe0886-71ea-470a-85da-cd42d81610d3 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.152817 Oct 12 00:30:49.238156 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 542/1085] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:49 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:50.260512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:50.261056 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:50.267788 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:50.268259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:50.268690 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:50.269368 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:50.269811 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:50.270225 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:50.400581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:50.408298 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4247c576-d01c-41ed-a7b3-23613a565738 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.151693 Oct 12 00:30:50.408854 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 544/1086] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:50 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:51.433318 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:51.433918 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:51.440005 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:51.440481 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:51.440912 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:51.441595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:51.442041 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:51.442457 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:51.573149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:51.581315 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-6730d680-07b9-4266-b981-a3a23852a810 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.151821 Oct 12 00:30:51.585160 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 543/1087] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:51 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:52.604516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:52.605117 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:52.612269 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:52.612719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:52.613153 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:52.613811 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:52.614259 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:52.614670 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:52.618639 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:30:52.746316 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:52.754133 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a53f0339-b4f7-47cd-b768-77aa606958f9 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.153418 Oct 12 00:30:52.755187 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 545/1088] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:52 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:53.776516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:53.777156 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:53.779475 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=29 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:30:53.784090 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:53.784566 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:53.784995 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:53.785680 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:53.786131 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:53.786548 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:53.790399 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=85 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:30:53.918721 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:53.926962 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-ef98732a-4c68-48e6-9c20-4d07d74dc1e8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.154243 Oct 12 00:30:53.927493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 544/1089] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:53 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:54.950493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:54.951095 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:54.953500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:30:54.959149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:54.959705 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:54.960133 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:54.964844 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:54.964844 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:54.964844 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:55.089998 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:55.097623 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0fa723f0-2f84-4fea-8cab-fe6d0d7636f0 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.151445 Oct 12 00:30:55.098177 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 546/1090] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:54 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:56.120880 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:56.122300 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:56.129370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:56.129880 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:56.130307 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:56.131000 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:56.131477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:56.131935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:56.265141 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:56.277223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1b7eb2d1-5512-438d-a068-a79f610c82d5 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.157384 Oct 12 00:30:56.277223 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 545/1091] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:56 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:57.296553 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:57.297158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:57.304602 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:57.305019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:57.305449 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:57.306138 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:57.306587 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:57.307007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:57.446682 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:57.454429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-135fde36-05bc-48cb-80cd-ff71291c6880 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.161709 Oct 12 00:30:57.455523 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 547/1092] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:57 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:57.609163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-90c08728-a4c8-437f-b934-69148450315a req-cceb175a-437a-475f-b077-862d87eb42fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23fd934-b03a-4259-8fd8-8dbcc42be866", "name": "network-vif-plugged", "status": "completed", "tag": "4ad8437d-d747-4320-afc4-1d72d58b1f96"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:30:57.618673 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-90c08728-a4c8-437f-b934-69148450315a req-cceb175a-437a-475f-b077-862d87eb42fd service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:57.619151 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-90c08728-a4c8-437f-b934-69148450315a req-cceb175a-437a-475f-b077-862d87eb42fd service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:57.619610 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-90c08728-a4c8-437f-b934-69148450315a req-cceb175a-437a-475f-b077-862d87eb42fd service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:57.630529 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-90c08728-a4c8-437f-b934-69148450315a req-cceb175a-437a-475f-b077-862d87eb42fd service nova] Creating event network-vif-plugged:4ad8437d-d747-4320-afc4-1d72d58b1f96 for instance b23fd934-b03a-4259-8fd8-8dbcc42be866 on hv-cinder-84914 Oct 12 00:30:57.635857 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-90c08728-a4c8-437f-b934-69148450315a req-cceb175a-437a-475f-b077-862d87eb42fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147587 Oct 12 00:30:57.636520 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 546/1093] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:30:58.478050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:58.478722 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:58.486530 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:58.487015 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:58.487543 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:58.488270 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:58.488826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:58.489151 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:58.620941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:58.628916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-982cc47c-c1f8-4469-b4bc-ec72be2348b8 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.154982 Oct 12 00:30:58.629667 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 548/1094] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:58 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:30:59.653432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:30:59.654126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:30:59.660280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:59.660750 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:59.661176 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:59.661859 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:30:59.662309 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:30:59.662726 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:30:59.799260 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:30:59.804277 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-b1606282-2bc0-4734-91b1-e86c0580eb7e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1575 microversion: 2.1 time: 0.155478 Oct 12 00:30:59.805124 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 547/1095] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:30:59 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:31:00.827964 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:31:00.828573 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:31:00.835698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:31:00.836173 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:31:00.836597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:31:00.837275 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:31:00.837720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:31:00.838134 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:31:00.966647 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:31:00.974597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-70df30b1-70eb-4c90-a147-1901b33cb4de tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1562 microversion: 2.1 time: 0.150535 Oct 12 00:31:00.975171 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 549/1096] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:31:00 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:31:46.739014 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=7 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:31:46.739992 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=19 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:31:46.911471 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-28169a69-6d5a-41ba-a9cc-585173b71cb5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Action: 'create', calling method: .version_select at 0x7f2fe8dada60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1182794385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLmk3toqzSlUfQFP3i/KRUVCmL9cZXu7fIdXcYJwqQglGsy0qrv0gvHIj4uHKPjPP2lTjz0G17Q2WvWYhf9nrcauUwLkZ4dmdJCfuE45Kq2CIg/819h//cPoNe/lVIS/A=="}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:31:46.927790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-28169a69-6d5a-41ba-a9cc-585173b71cb5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Getting quotas for project 764ed0f4ff5d4c48b89dc4be9460323b. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:31:46.932142 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-28169a69-6d5a-41ba-a9cc-585173b71cb5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Getting quotas for user 828b7770373f4e9688b0f218f7fd6e4f and project 764ed0f4ff5d4c48b89dc4be9460323b. Resources: {'key_pairs'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:31:46.946741 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR oslo.messaging._drivers.impl_rabbit [None req-28169a69-6d5a-41ba-a9cc-585173b71cb5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [c6ca8003-dbbd-4c0c-8c3a-84d0136c7c74] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 00:31:47.954882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO oslo.messaging._drivers.impl_rabbit [None req-28169a69-6d5a-41ba-a9cc-585173b71cb5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [c6ca8003-dbbd-4c0c-8c3a-84d0136c7c74] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59798. Oct 12 00:31:48.015301 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-28169a69-6d5a-41ba-a9cc-585173b71cb5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.281156 Oct 12 00:31:48.015999 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 548/1097] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Oct 12 00:31:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:32:08.056976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=7 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:32:08.057731 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=28 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:32:08.062174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1685178736", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1182794385", "security_groups": [{"name": "tempest-secgroup-smoke-516494631"}], "block_device_mapping_v2": [{"uuid": "14a6de0b-4574-42de-af1e-03393002b0cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a02dece-4b1c-4c17-bb61-97d2fc408cbe"}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:32:08.175267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] validate_networks() for [('2a02dece-4b1c-4c17-bb61-97d2fc408cbe', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:32:08.635916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:32:08.636330 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:32:08.636795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:32:08.637194 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:32:08.637594 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:32:08.646263 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:08.646983 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:08.647440 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:08.648155 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:08.648600 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:08.649014 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:08.665090 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Getting quotas for project 764ed0f4ff5d4c48b89dc4be9460323b. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:32:08.669482 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Getting quotas for user 828b7770373f4e9688b0f218f7fd6e4f and project 764ed0f4ff5d4c48b89dc4be9460323b. Resources: {'instances', 'ram', 'cores'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:32:08.725419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:32:08.727569 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14a6de0b-4574-42de-af1e-03393002b0cb',volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:32:09.071929 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-35ed5a42-4cfd-4a88-9786-2a894d7cad64 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.016512 Oct 12 00:32:09.072645 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 550/1098] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:32:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 00:32:09.081321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=4 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:32:09.082087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:32:09.082998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:32:09.083137 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Wed Oct 12 00:32:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 (ip 10.222.0.36) !!! Oct 12 00:32:09.087289 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1290f03c-c69e-4fb9-97b6-f9aeb883c430 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:09.088422 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1290f03c-c69e-4fb9-97b6-f9aeb883c430 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:09.146191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1290f03c-c69e-4fb9-97b6-f9aeb883c430 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:09.153673 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1290f03c-c69e-4fb9-97b6-f9aeb883c430 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1095 microversion: 2.1 time: 0.073677 Oct 12 00:32:09.161247 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 549/1099] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:09 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1095 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:10.176371 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:10.176989 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:10.184389 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:10.184874 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:10.185369 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:10.186076 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:10.186535 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:10.187043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:10.246819 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:10.254574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cd9a0fdc-9b8b-49a3-a534-f663f4d84467 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1137 microversion: 2.1 time: 0.082649 Oct 12 00:32:10.255142 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 551/1100] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:10 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:11.280545 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:11.281682 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:11.289250 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:11.294665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:11.294665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:11.294665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:11.294665 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:11.295088 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:11.363445 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:11.371645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d9745cd9-2647-45fd-820b-15f5f615d530 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1211 microversion: 2.1 time: 0.097995 Oct 12 00:32:11.372200 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 550/1101] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:11 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:12.394982 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:12.395616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:12.402419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:12.402899 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:12.403333 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:12.404064 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:12.404519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:12.404976 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:12.551714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:12.554532 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b009bb9b-1482-4ab4-8b77-92bd5c95be3f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1278 microversion: 2.1 time: 0.163269 Oct 12 00:32:12.555325 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 552/1102] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:12 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:12.864563 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-c858176c-19db-4852-8134-5ce87bac8f1a req-af296349-f25e-4692-b70f-60365f6da43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50686e7-ef13-42ad-b479-ae1326018ba4", "tag": "b8ea00c5-d1c7-47c3-9be5-0d340c81802b"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:32:12.874254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-c858176c-19db-4852-8134-5ce87bac8f1a req-af296349-f25e-4692-b70f-60365f6da43b service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:12.877863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-c858176c-19db-4852-8134-5ce87bac8f1a req-af296349-f25e-4692-b70f-60365f6da43b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:12.877863 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-c858176c-19db-4852-8134-5ce87bac8f1a req-af296349-f25e-4692-b70f-60365f6da43b service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:12.886096 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-c858176c-19db-4852-8134-5ce87bac8f1a req-af296349-f25e-4692-b70f-60365f6da43b service nova] Creating event network-changed:b8ea00c5-d1c7-47c3-9be5-0d340c81802b for instance c50686e7-ef13-42ad-b479-ae1326018ba4 on hv-cinder-84914 Oct 12 00:32:12.891169 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-c858176c-19db-4852-8134-5ce87bac8f1a req-af296349-f25e-4692-b70f-60365f6da43b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092481 Oct 12 00:32:12.891787 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 551/1103] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:32:13.578671 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:13.579522 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:13.586324 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:13.586801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:13.587231 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:13.587954 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:13.588487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:13.588900 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:13.722742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:13.730672 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0be6dfdd-f9c8-4382-aeb7-48b95ecc03e0 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.156296 Oct 12 00:32:13.731278 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 553/1104] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:13 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:32:14.755685 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:14.756393 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:14.762997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:14.763513 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:14.763954 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:14.764648 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:14.765101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:14.765527 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:14.895295 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:14.903997 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-79b06d2d-79df-4ef0-bb88-72bcfc3e98cd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.153057 Oct 12 00:32:14.904572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 552/1105] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:14 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:15.925955 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:15.926560 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:15.933368 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:15.934694 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:15.934694 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:15.934912 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:15.935355 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:15.935795 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:16.066181 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:16.073826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-15bc79aa-cc10-4b5c-8d80-c8d64362ec00 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.151759 Oct 12 00:32:16.074383 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 554/1106] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:15 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:17.097246 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:17.097856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:17.104343 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:17.104821 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:17.105257 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:17.105940 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:17.106389 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:17.106807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:17.237540 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:17.245124 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-48966e5d-eaf2-4c9e-aa5c-5d13baa2a7a5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.151878 Oct 12 00:32:17.245689 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 553/1107] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:17 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:18.267575 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:18.268114 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:18.274752 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:18.275226 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:18.276187 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:18.276865 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:18.277312 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:18.277731 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:18.404420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:18.412085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dbd3aea8-3cb9-4514-9d68-a3fdd3200808 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.148502 Oct 12 00:32:18.412643 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 555/1108] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:18 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:19.435679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:19.436281 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:19.438694 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:32:19.450382 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:19.450382 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:19.450382 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:19.450382 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:19.450835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:19.450835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:19.573723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:19.581369 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-deb98518-d8a6-40e9-9536-f066043ce217 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.150132 Oct 12 00:32:19.581935 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 554/1109] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:19 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:20.604684 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:20.605277 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:20.607150 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:32:20.607962 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:32:20.612544 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:20.613017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:20.613446 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:20.614147 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:20.614632 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:20.614993 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:20.802178 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:20.810426 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a44485c0-c9bd-4e00-b9e2-8e0505660e10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.209816 Oct 12 00:32:20.811606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 556/1110] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:20 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:32:20.934453 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:20.934967 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:20.941312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:20.941786 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:20.942403 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:20.943094 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:20.943566 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:20.943990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:20.969342 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:32:21.000320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-538093c7-1e84-4a6c-a182-690504786694 req-886c1371-7848-4277-9f92-2082e5a74b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b23fd934-b03a-4259-8fd8-8dbcc42be866", "tag": "4ad8437d-d747-4320-afc4-1d72d58b1f96"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:32:21.010911 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-538093c7-1e84-4a6c-a182-690504786694 req-886c1371-7848-4277-9f92-2082e5a74b5e service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:21.011499 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-538093c7-1e84-4a6c-a182-690504786694 req-886c1371-7848-4277-9f92-2082e5a74b5e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:21.011988 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-538093c7-1e84-4a6c-a182-690504786694 req-886c1371-7848-4277-9f92-2082e5a74b5e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:21.023182 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-538093c7-1e84-4a6c-a182-690504786694 req-886c1371-7848-4277-9f92-2082e5a74b5e service nova] Creating event network-changed:4ad8437d-d747-4320-afc4-1d72d58b1f96 for instance b23fd934-b03a-4259-8fd8-8dbcc42be866 on hv-cinder-84914 Oct 12 00:32:21.029289 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-538093c7-1e84-4a6c-a182-690504786694 req-886c1371-7848-4277-9f92-2082e5a74b5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097319 Oct 12 00:32:21.030234 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 557/1111] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:32:21.196240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c2b504f4-e49e-4cae-abf3-b95bc5551e01 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 204 len: 0 microversion: 2.1 time: 0.266359 Oct 12 00:32:21.196833 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 555/1112] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:32:20 2022] DELETE /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:32:21.205519 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:21.206160 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:21.212680 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:21.213683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:21.214109 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:21.214800 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:21.215243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:21.215686 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:21.352916 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:21.361361 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1c0c8c6a-b938-4db8-b3a0-1c3273f8a8fd tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.160094 Oct 12 00:32:21.361944 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 558/1113] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:21 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:21.834504 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:21.835209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:21.846376 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:21.846376 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:21.846376 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:21.846376 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:21.846738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:21.846738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:21.981501 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:21.989226 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-fd1db453-d889-4b8b-bb4b-690094b35f86 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.158929 Oct 12 00:32:21.989801 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 556/1114] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:21 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:22.385354 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:22.385890 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:22.392230 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:22.392704 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:22.393130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:22.393813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:22.394276 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:22.394674 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:22.524518 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:22.533328 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-35bc8084-debb-45e8-867b-c21fe5c56699 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1568 microversion: 2.1 time: 0.151883 Oct 12 00:32:22.533892 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 559/1115] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:22 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:23.012681 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:23.013924 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:23.020071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:23.020555 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:23.020990 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:23.021937 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:23.022572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:23.022867 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:23.222191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:23.232548 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e73a7c80-77e7-46e8-80c3-2becd7901741 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.224085 Oct 12 00:32:23.234371 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 557/1116] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:23 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:23.558358 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:23.558979 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:23.565907 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:23.566396 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:23.566831 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:23.567576 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:23.568033 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:23.568462 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:23.707618 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:23.716042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-045cc34c-b62e-4531-bb4c-26eb36f64c58 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1450 microversion: 2.1 time: 0.162287 Oct 12 00:32:23.716630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 560/1117] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:23 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:23.951753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-e6f7cfc7-3a8a-4ab6-8262-f2ade2c04cc4 req-f61c858b-f64e-48f0-aaeb-453c164ef23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b23fd934-b03a-4259-8fd8-8dbcc42be866", "name": "network-vif-deleted", "tag": "4ad8437d-d747-4320-afc4-1d72d58b1f96"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:32:23.964070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e6f7cfc7-3a8a-4ab6-8262-f2ade2c04cc4 req-f61c858b-f64e-48f0-aaeb-453c164ef23c service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:23.964070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e6f7cfc7-3a8a-4ab6-8262-f2ade2c04cc4 req-f61c858b-f64e-48f0-aaeb-453c164ef23c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:23.964070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-e6f7cfc7-3a8a-4ab6-8262-f2ade2c04cc4 req-f61c858b-f64e-48f0-aaeb-453c164ef23c service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:23.973133 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-e6f7cfc7-3a8a-4ab6-8262-f2ade2c04cc4 req-f61c858b-f64e-48f0-aaeb-453c164ef23c service nova] Creating event network-vif-deleted:4ad8437d-d747-4320-afc4-1d72d58b1f96 for instance b23fd934-b03a-4259-8fd8-8dbcc42be866 on hv-cinder-84914 Oct 12 00:32:23.977938 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-e6f7cfc7-3a8a-4ab6-8262-f2ade2c04cc4 req-f61c858b-f64e-48f0-aaeb-453c164ef23c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029887 Oct 12 00:32:23.979059 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 558/1118] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:32:24.069601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-4c5e701f-a770-40b1-9027-aef0e756325b req-47da5a0c-3242-42ac-ac46-111fff486456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50686e7-ef13-42ad-b479-ae1326018ba4", "name": "network-vif-plugged", "status": "completed", "tag": "b8ea00c5-d1c7-47c3-9be5-0d340c81802b"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:32:24.079485 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4c5e701f-a770-40b1-9027-aef0e756325b req-47da5a0c-3242-42ac-ac46-111fff486456 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:24.079967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4c5e701f-a770-40b1-9027-aef0e756325b req-47da5a0c-3242-42ac-ac46-111fff486456 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:24.080395 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4c5e701f-a770-40b1-9027-aef0e756325b req-47da5a0c-3242-42ac-ac46-111fff486456 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:24.091842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-4c5e701f-a770-40b1-9027-aef0e756325b req-47da5a0c-3242-42ac-ac46-111fff486456 service nova] Creating event network-vif-plugged:b8ea00c5-d1c7-47c3-9be5-0d340c81802b for instance c50686e7-ef13-42ad-b479-ae1326018ba4 on hv-cinder-84914 Oct 12 00:32:24.097004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-4c5e701f-a770-40b1-9027-aef0e756325b req-47da5a0c-3242-42ac-ac46-111fff486456 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031325 Oct 12 00:32:24.097591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 561/1119] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:32:24.256157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:24.259595 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:24.263274 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:24.263987 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:24.264831 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:24.265549 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:24.265998 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:24.266424 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:24.410172 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:24.418552 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-a3a1e5cb-acfa-40ad-b5ae-5e0ce3469ddf tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.167147 Oct 12 00:32:24.419128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 559/1120] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:24 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:24.740318 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:24.741345 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:24.748356 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:24.748837 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:24.749268 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:24.749966 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:24.750416 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:24.750859 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:24.813150 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:24.820850 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5cf84aef-540a-40bd-8aa3-86b5b1c77c15 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1220 microversion: 2.1 time: 0.084767 Oct 12 00:32:24.821410 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 562/1121] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:24 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:25.446126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:25.446735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:25.453277 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:25.453757 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:25.454189 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:25.454882 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:25.455331 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:25.455785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:25.587133 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:25.595200 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-eea0df08-dc8f-45f2-b610-c0d5516906af tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1266 microversion: 2.1 time: 0.153075 Oct 12 00:32:25.595785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 560/1122] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:25 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:25.844557 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:25.845102 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:25.851836 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:25.852360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:25.852794 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:25.854120 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:25.854574 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:25.854997 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:25.888255 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:25.888732 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:25.889165 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:25.889599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lazy-loading 'fault' on Instance uuid b23fd934-b03a-4259-8fd8-8dbcc42be866 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:32:25.933360 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da2a3fcb0287474cb93238923aa9c7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '654843d065264b9e9296824daf702110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:25.940446 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-719ff676-4e27-4ede-84a4-7198684b2ad7 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 200 len: 1225 microversion: 2.1 time: 0.099878 Oct 12 00:32:25.941004 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 563/1123] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:25 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:26.618916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:26.668008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:26.668008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:26.668008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:26.668008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:26.668459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:26.668459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:26.668459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:26.756310 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:26.764507 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-7cdc06e9-df24-49c2-a2e5-7ddc6b770306 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1454 microversion: 2.1 time: 0.149482 Oct 12 00:32:26.765069 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 561/1124] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:26 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:32:26.787059 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:26.787698 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:26.793682 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:26.794104 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:26.794531 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:26.795215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:26.795707 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:26.796130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:26.924902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:32:26.932549 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-48dad591-bf28-4571-ad15-9d3312a8a832 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1454 microversion: 2.1 time: 0.149264 Oct 12 00:32:26.933109 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 564/1125] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:26 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:32:26.970047 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:26.970730 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] [instance: b23fd934-b03a-4259-8fd8-8dbcc42be866] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:32:26.976957 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:26.977505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:26.978013 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:26.978735 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:26.979190 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:26.979641 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:26.992815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] HTTP exception thrown: Instance b23fd934-b03a-4259-8fd8-8dbcc42be866 could not be found. Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Request method failure captured: Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 HTTP/1.1 Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgno1VgEqSxtLnWzO0EAkIs1eA3mGRBP2PyfOSTdOD2WvZ8SH8loKWbkz6w-bS408B_Hv6NWIFEG_aHCS1CdHzeQtiT5EQVfvxR52rSvauYghcOw_-dgR8zH_bguErkGFVpvZXHGFcyDBCh7EfRsC6yCrJI-NhveqBt4rtTG8dLUqe4 Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 654843d065264b9e9296824daf702110 Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-TestShelveInstance-771858459 Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:32:26.994486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_654843d065264b9e9296824daf702110", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/654843d065264b9e9296824daf702110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/654843d065264b9e9296824daf702110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/654843d065264b9e9296824daf702110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-TestShelveInstance-771858459 Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 654843d065264b9e9296824daf702110 Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-TestShelveInstance-771858459 Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-TestShelveInstance-771858459-project Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: da2a3fcb0287474cb93238923aa9c7c1 Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-TestShelveInstance-771858459-project Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance b23fd934-b03a-4259-8fd8-8dbcc42be866 could not be found. Oct 12 00:32:26.996262 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'b23fd934-b03a-4259-8fd8-8dbcc42be866'} Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b23fd934-b03a-4259-8fd8-8dbcc42be866 could not be found. Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:32:26.997165 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b23fd934-b03a-4259-8fd8-8dbcc42be866 could not be found. Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b23fd934-b03a-4259-8fd8-8dbcc42be866 could not be found. Oct 12 00:32:26.998477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:32:26.999690 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Returning 404 to user: Instance b23fd934-b03a-4259-8fd8-8dbcc42be866 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:32:26.999690 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-50ac36b7-9a0f-4fa1-bd16-368da5d8be8e tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866" status: 404 len: 111 microversion: 2.1 time: 0.029742 Oct 12 00:32:26.999690 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 562/1126] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:32:26 2022] GET /compute/v2.1/servers/b23fd934-b03a-4259-8fd8-8dbcc42be866 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:32:27.207262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c4ac7176-aced-4a28-a387-dec48ec8f726 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] Calling method '.version_select at 0x7f2fe8e49940>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:32:27.311508 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c4ac7176-aced-4a28-a387-dec48ec8f726 tempest-TestShelveInstance-771858459 tempest-TestShelveInstance-771858459-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1677283004" status: 202 len: 0 microversion: 2.1 time: 0.108113 Oct 12 00:32:27.312042 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 565/1127] 10.222.0.36 () {58 vars in 1254 bytes} [Wed Oct 12 00:32:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1677283004 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 00:32:29.274463 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-36f68bda-0047-4887-b2e0-5e515c3129f5 req-c44ea6e6-17c1-4887-96b8-354d3b62e849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50686e7-ef13-42ad-b479-ae1326018ba4", "tag": "b8ea00c5-d1c7-47c3-9be5-0d340c81802b"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:32:29.282733 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-36f68bda-0047-4887-b2e0-5e515c3129f5 req-c44ea6e6-17c1-4887-96b8-354d3b62e849 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:32:29.283493 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-36f68bda-0047-4887-b2e0-5e515c3129f5 req-c44ea6e6-17c1-4887-96b8-354d3b62e849 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:32:29.284128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-36f68bda-0047-4887-b2e0-5e515c3129f5 req-c44ea6e6-17c1-4887-96b8-354d3b62e849 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:32:29.296773 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-36f68bda-0047-4887-b2e0-5e515c3129f5 req-c44ea6e6-17c1-4887-96b8-354d3b62e849 service nova] Creating event network-changed:b8ea00c5-d1c7-47c3-9be5-0d340c81802b for instance c50686e7-ef13-42ad-b479-ae1326018ba4 on hv-cinder-84914 Oct 12 00:32:29.302574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-36f68bda-0047-4887-b2e0-5e515c3129f5 req-c44ea6e6-17c1-4887-96b8-354d3b62e849 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036572 Oct 12 00:32:29.311542 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 563/1128] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:34:26.289017 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c5750a3d-2a19-445c-b8fc-f1f2883b474d] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 00:34:26.289625 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=80 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:34:26.290375 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:34:26.295392 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:26.296661 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:26.301886 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:26.302367 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:26.302801 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:26.303516 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:26.303970 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:26.304413 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:26.330475 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:34:26.536714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8b2534f9-62dd-478d-ad41-db7bb26b7118 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 204 len: 0 microversion: 2.1 time: 0.249211 Oct 12 00:34:26.537308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 566/1129] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:34:26 2022] DELETE /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:34:26.545938 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9dcf231b-214b-4a59-bbee-67e4318698ce] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 12 00:34:26.545938 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:34:26.546456 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:34:26.547294 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 12 00:34:26.553051 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:26.553752 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:26.559958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:26.561064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:26.561505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:26.562194 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:26.562736 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:26.563240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:26.695093 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:26.703208 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-f44f5b2b-1d97-41ce-837a-154b8d3d5655 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1578 microversion: 2.1 time: 0.161245 Oct 12 00:34:26.703818 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 564/1130] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:26 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:27.726896 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:27.727655 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:27.736067 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:27.736583 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:27.737020 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:27.737719 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:27.738174 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:27.738601 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:27.744033 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO oslo.messaging._drivers.impl_rabbit [-] [c5750a3d-2a19-445c-b8fc-f1f2883b474d] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60102. Oct 12 00:34:27.874571 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:27.882274 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-95bf24d1-ea9b-4299-ad3f-48040c0c05f7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1578 microversion: 2.1 time: 0.159621 Oct 12 00:34:27.882848 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 567/1131] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:27 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:28.907042 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:28.907663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:28.915263 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:28.915774 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:28.916209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:28.916908 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:28.917367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:28.917790 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:28.933861 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO oslo.messaging._drivers.impl_rabbit [-] [9dcf231b-214b-4a59-bbee-67e4318698ce] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60108. Oct 12 00:34:29.135378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:29.143856 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0bc68449-1664-4c4e-94a9-57531303dfb8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1578 microversion: 2.1 time: 0.241639 Oct 12 00:34:29.144430 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 565/1132] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:28 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:29.561850 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-da15c33c-04b3-4baa-ad4d-96cb5a07adbe req-f04c18c8-243b-4782-8ad6-0c5c5f33096e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50686e7-ef13-42ad-b479-ae1326018ba4", "name": "network-vif-deleted", "tag": "b8ea00c5-d1c7-47c3-9be5-0d340c81802b"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:34:29.572165 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-da15c33c-04b3-4baa-ad4d-96cb5a07adbe req-f04c18c8-243b-4782-8ad6-0c5c5f33096e service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:29.572808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-da15c33c-04b3-4baa-ad4d-96cb5a07adbe req-f04c18c8-243b-4782-8ad6-0c5c5f33096e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:29.573085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-da15c33c-04b3-4baa-ad4d-96cb5a07adbe req-f04c18c8-243b-4782-8ad6-0c5c5f33096e service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:29.584220 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-da15c33c-04b3-4baa-ad4d-96cb5a07adbe req-f04c18c8-243b-4782-8ad6-0c5c5f33096e service nova] Creating event network-vif-deleted:b8ea00c5-d1c7-47c3-9be5-0d340c81802b for instance c50686e7-ef13-42ad-b479-ae1326018ba4 on hv-cinder-84914 Oct 12 00:34:29.588969 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-da15c33c-04b3-4baa-ad4d-96cb5a07adbe req-f04c18c8-243b-4782-8ad6-0c5c5f33096e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031982 Oct 12 00:34:29.589743 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 568/1133] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:34:30.167490 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:30.168266 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:30.175593 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:30.176071 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:30.176810 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:30.177897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:30.178346 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:30.178934 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:30.246347 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:30.254871 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-660cdf88-df52-4d43-aa85-a0590b6091bd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 200 len: 1226 microversion: 2.1 time: 0.091558 Oct 12 00:34:30.255811 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 566/1134] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:30 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:31.279015 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:31.279740 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:31.285947 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:31.286421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:31.286858 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:31.287718 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:31.288020 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:31.288438 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:31.302100 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] HTTP exception thrown: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Request method failure captured: Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 HTTP/1.1 Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgrsDWVLFBgChaRU3K_uFCnZt6MBzQQj2iLXaTDzXRyqKOphTMYzAYdjc3RHWavdoDaZDWXNVplfgryetnVYSuUvZMZeGmnFhg_0iWlfQ_aOP9JihMiLSlXHU96QWf7Y-z1GBXFyTimyeD3Ao-YnovLGnsEWfMCiMvQb6A0r2uBm4gw Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:34:31.303771 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_764ed0f4ff5d4c48b89dc4be9460323b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: 828b7770373f4e9688b0f218f7fd6e4f Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:34:31.309654 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'c50686e7-ef13-42ad-b479-ae1326018ba4'} Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:34:31.311315 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:34:31.312808 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:34:31.314085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Returning 404 to user: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:34:31.314085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-00552b56-b8e5-41a1-9514-9d28a8842c21 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 404 len: 111 microversion: 2.1 time: 0.030838 Oct 12 00:34:31.314085 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 569/1135] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:31 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:34:31.402243 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-149209800", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1182794385", "security_groups": [{"name": "tempest-secgroup-smoke-516494631"}], "block_device_mapping_v2": [{"uuid": "14a6de0b-4574-42de-af1e-03393002b0cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a02dece-4b1c-4c17-bb61-97d2fc408cbe"}]}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:34:31.513679 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] validate_networks() for [('2a02dece-4b1c-4c17-bb61-97d2fc408cbe', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:34:31.971675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:34:31.972101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:34:31.972570 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:34:31.972976 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:34:31.973378 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:34:31.982150 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:31.982628 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:31.983061 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:31.983820 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:31.984271 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:31.984694 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:32.000946 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Getting quotas for project 764ed0f4ff5d4c48b89dc4be9460323b. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:34:32.004866 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Getting quotas for user 828b7770373f4e9688b0f218f7fd6e4f and project 764ed0f4ff5d4c48b89dc4be9460323b. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:34:32.061917 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:34:32.064046 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='14a6de0b-4574-42de-af1e-03393002b0cb',volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:34:32.489032 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-94c2e704-92c1-486f-8787-0bd3e4a6212d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.090581 Oct 12 00:34:32.489981 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 567/1136] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:34:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:34:32.501575 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-31b44e7f-3845-4b4a-90b2-eee68822b01f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:32.502313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-31b44e7f-3845-4b4a-90b2-eee68822b01f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:32.558960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-31b44e7f-3845-4b4a-90b2-eee68822b01f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:32.567591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-31b44e7f-3845-4b4a-90b2-eee68822b01f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1094 microversion: 2.1 time: 0.070312 Oct 12 00:34:32.568363 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 570/1137] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:32 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:33.591114 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:33.594476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:33.597995 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:33.598643 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:33.599168 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:33.599786 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:33.600244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:33.600663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:33.661728 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:33.669512 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5af8eb1a-549a-40f7-ba15-490514afc081 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1136 microversion: 2.1 time: 0.082920 Oct 12 00:34:33.670070 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 568/1138] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:33 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:34.692339 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:34.692948 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:34.700215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:34.700937 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:34.702033 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:34.702932 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:34.703397 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:34.703825 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:34.767868 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:34.775925 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-67283fbd-a0d2-41f4-b1c2-6d84fcc2e7ea tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1210 microversion: 2.1 time: 0.087446 Oct 12 00:34:34.776493 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 571/1139] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:34 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:35.799316 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:35.799967 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:35.806406 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:35.806892 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:35.807581 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:35.808283 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:35.808748 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:35.809175 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:36.266504 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:36.274430 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-490fc83d-6c24-4c5e-95cd-8dbdd9e12585 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1277 microversion: 2.1 time: 0.479685 Oct 12 00:34:36.278766 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 569/1140] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:35 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1277 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:36.465494 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-0b1c5772-53ff-4ad2-911a-b536293fad0e req-e831148a-f70d-4b87-ba5a-4a93cbdf67bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e94b5bd6-79cb-4441-899f-bc8236b949a5", "tag": "2c050379-d781-411c-bf85-a57395ae94f9"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:34:36.476103 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-0b1c5772-53ff-4ad2-911a-b536293fad0e req-e831148a-f70d-4b87-ba5a-4a93cbdf67bd service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:36.476584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-0b1c5772-53ff-4ad2-911a-b536293fad0e req-e831148a-f70d-4b87-ba5a-4a93cbdf67bd service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:36.477047 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-0b1c5772-53ff-4ad2-911a-b536293fad0e req-e831148a-f70d-4b87-ba5a-4a93cbdf67bd service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:36.488840 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-0b1c5772-53ff-4ad2-911a-b536293fad0e req-e831148a-f70d-4b87-ba5a-4a93cbdf67bd service nova] Creating event network-changed:2c050379-d781-411c-bf85-a57395ae94f9 for instance e94b5bd6-79cb-4441-899f-bc8236b949a5 on hv-cinder-84914 Oct 12 00:34:36.493979 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-0b1c5772-53ff-4ad2-911a-b536293fad0e req-e831148a-f70d-4b87-ba5a-4a93cbdf67bd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032080 Oct 12 00:34:36.497440 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 572/1141] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:34:37.298623 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:37.299210 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:37.305627 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:37.306100 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:37.306528 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:37.307207 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:37.307678 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:37.308101 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:37.436394 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:37.444008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-25662198-70f8-4e6e-be21-abba72c0712a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.149761 Oct 12 00:34:37.444563 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 570/1142] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:37 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:38.467987 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:38.468678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:38.474748 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:38.475220 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:38.475668 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:38.476351 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:38.476792 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:38.477211 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:38.609991 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:38.617585 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9aa2bac9-6104-4873-a91b-869bcf71cb7f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.154270 Oct 12 00:34:38.618152 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 573/1143] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:38 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:39.641242 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:39.641847 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:39.648577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:39.649049 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:39.649476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:39.650155 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:39.650599 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:39.651013 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:39.782976 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:39.790830 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-cb973876-6643-486e-97c6-5581212a6000 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.154066 Oct 12 00:34:39.791425 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 571/1144] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:39 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:40.813608 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:40.814132 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:40.820496 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:40.820967 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:40.821393 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:40.822070 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:40.822513 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:40.822926 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:40.949420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:40.957489 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2afea3cd-0b63-42ec-b2e0-3f69e987646a tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.147787 Oct 12 00:34:40.958043 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 574/1145] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:40 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:41.980533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:41.981135 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:41.988139 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:41.988608 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:41.989062 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:41.989758 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:41.990217 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:41.990631 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:41.993146 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:34:42.011743 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=6 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:34:42.122275 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:42.129893 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2b94ca32-3f9c-4277-b4ba-78d19a17fd08 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.153244 Oct 12 00:34:42.130460 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 572/1146] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:41 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:43.153599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:43.154215 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:43.156636 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:34:43.161468 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:43.164630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:43.164630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:43.164630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:43.164630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:43.165016 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:43.295595 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:43.303835 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f5c33178-eb50-447e-aba5-27d6b87af8e1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.154053 Oct 12 00:34:43.304401 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 575/1147] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:43 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:44.326805 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:44.328206 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:44.334517 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:44.334988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:44.335444 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:44.336127 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:44.336568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:44.336983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:44.461867 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:44.469359 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1d54d904-895e-4b91-9dda-f56a2b5cdebd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.146735 Oct 12 00:34:44.469916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 573/1148] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:44 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:45.492460 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:45.493100 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:45.499599 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:45.500021 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:45.500454 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:45.501144 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:45.501597 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:45.502019 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:45.629073 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:45.636768 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fa3e7bdd-3b12-4234-af30-bf1310dd5f4d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.148161 Oct 12 00:34:45.637419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 576/1149] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:45 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:34:46.660886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:46.661495 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:46.668145 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:46.670572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:46.670572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:46.670572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:46.670572 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:46.671007 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:46.805220 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:46.814411 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-2063cacf-5487-4179-bae5-5bd2b43a4bd5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.157395 Oct 12 00:34:46.819612 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 574/1150] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:46 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:46.854420 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-4b897a2f-0222-4eba-a7fe-33818c92ceeb req-d5bc5d22-7a5f-4b23-a54a-fd023f944b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e94b5bd6-79cb-4441-899f-bc8236b949a5", "name": "network-vif-plugged", "status": "completed", "tag": "2c050379-d781-411c-bf85-a57395ae94f9"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:34:46.864179 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4b897a2f-0222-4eba-a7fe-33818c92ceeb req-d5bc5d22-7a5f-4b23-a54a-fd023f944b2a service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:46.864650 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4b897a2f-0222-4eba-a7fe-33818c92ceeb req-d5bc5d22-7a5f-4b23-a54a-fd023f944b2a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:46.865074 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4b897a2f-0222-4eba-a7fe-33818c92ceeb req-d5bc5d22-7a5f-4b23-a54a-fd023f944b2a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:46.875712 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-4b897a2f-0222-4eba-a7fe-33818c92ceeb req-d5bc5d22-7a5f-4b23-a54a-fd023f944b2a service nova] Creating event network-vif-plugged:2c050379-d781-411c-bf85-a57395ae94f9 for instance e94b5bd6-79cb-4441-899f-bc8236b949a5 on hv-cinder-84914 Oct 12 00:34:46.880541 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-4b897a2f-0222-4eba-a7fe-33818c92ceeb req-d5bc5d22-7a5f-4b23-a54a-fd023f944b2a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029758 Oct 12 00:34:46.881109 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 577/1151] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:34:47.836928 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:47.837522 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:47.844370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:47.844848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:47.845280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:47.845964 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:47.846414 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:47.846837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:47.980749 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:47.986009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-cc43e0cf-c1b8-4181-b835-f69f9858ec42 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1265 microversion: 2.1 time: 0.153002 Oct 12 00:34:47.986578 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 575/1152] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:47 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:49.009714 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:49.010414 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:49.016536 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:49.017013 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:49.017446 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:49.018169 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:49.018630 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:49.019052 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:49.148363 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:49.156045 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7e0fcb58-b9d2-4d69-ac97-36035fd4839c tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1453 microversion: 2.1 time: 0.151055 Oct 12 00:34:49.156616 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 578/1153] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:49 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:49.178156 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:34:49.178761 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:34:49.185093 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:49.185568 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:49.186002 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:49.187341 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:49.187822 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:49.188248 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:49.314142 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:34:49.321829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-dca8695c-f4f2-4e3a-8942-5909376a3997 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1453 microversion: 2.1 time: 0.147501 Oct 12 00:34:49.322392 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 576/1154] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:34:49 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:34:51.150130 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-6e49c0f5-e8f0-4440-9052-cc2289586041 req-f88a37c5-8012-4e1c-91c8-d32cc605c6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e94b5bd6-79cb-4441-899f-bc8236b949a5", "tag": "2c050379-d781-411c-bf85-a57395ae94f9"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:34:51.160722 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6e49c0f5-e8f0-4440-9052-cc2289586041 req-f88a37c5-8012-4e1c-91c8-d32cc605c6d6 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:34:51.161207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6e49c0f5-e8f0-4440-9052-cc2289586041 req-f88a37c5-8012-4e1c-91c8-d32cc605c6d6 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:34:51.161725 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6e49c0f5-e8f0-4440-9052-cc2289586041 req-f88a37c5-8012-4e1c-91c8-d32cc605c6d6 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:34:51.172960 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-6e49c0f5-e8f0-4440-9052-cc2289586041 req-f88a37c5-8012-4e1c-91c8-d32cc605c6d6 service nova] Creating event network-changed:2c050379-d781-411c-bf85-a57395ae94f9 for instance e94b5bd6-79cb-4441-899f-bc8236b949a5 on hv-cinder-84914 Oct 12 00:34:51.177812 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-6e49c0f5-e8f0-4440-9052-cc2289586041 req-f88a37c5-8012-4e1c-91c8-d32cc605c6d6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031535 Oct 12 00:34:51.178421 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 579/1155] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:36:38.652064 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:36:38.652818 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=74 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:36:38.653663 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:36:38.653799 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Wed Oct 12 00:36:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Oct 12 00:36:38.658477 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-107267673", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1182794385", "security_groups": [{"name": "tempest-secgroup-smoke-516494631"}], "block_device_mapping_v2": [{"uuid": "e372bf5b-b380-47bb-a5f3-681a62577c28", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2a02dece-4b1c-4c17-bb61-97d2fc408cbe"}]}} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:36:38.981786 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.network.neutron [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] validate_networks() for [('2a02dece-4b1c-4c17-bb61-97d2fc408cbe', None, None, None, None, None)] {{(pid=125809) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 00:36:39.337908 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Flavor limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 00:36:39.338326 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Image limits 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 00:36:39.338792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Flavor pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 00:36:39.339198 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Image pref 0:0:0 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 00:36:39.339636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.virt.hardware [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125809) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 00:36:39.348164 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:39.348634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:39.349059 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:39.349772 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:39.350216 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:39.350634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:39.367922 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Getting quotas for project 764ed0f4ff5d4c48b89dc4be9460323b. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 00:36:39.371634 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.quota [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Getting quotas for user 828b7770373f4e9688b0f218f7fd6e4f and project 764ed0f4ff5d4c48b89dc4be9460323b. Resources: {'instances', 'ram', 'cores'} {{(pid=125809) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 00:36:39.428466 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Going to run 1 instances... {{(pid=125809) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 00:36:39.430516 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e372bf5b-b380-47bb-a5f3-681a62577c28',volume_size=None,volume_type=None)] {{(pid=125809) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 00:36:39.827713 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1f18504f-ee27-46fa-ac51-f5029c23f946 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.177311 Oct 12 00:36:39.829153 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 577/1156] 10.222.0.36 () {60 vars in 1147 bytes} [Wed Oct 12 00:36:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 00:36:39.838487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c5750a3d-2a19-445c-b8fc-f1f2883b474d] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 12 00:36:39.839002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:36:39.840145 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:36:39.841329 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:36:39.841456 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Wed Oct 12 00:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 (ip 10.222.0.36) !!! Oct 12 00:36:39.842591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:36:39.842591 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Wed Oct 12 00:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 (ip 10.222.0.36) !!! Oct 12 00:36:39.848624 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-274d6422-4a94-46fa-89b0-89e89324e885 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:39.851788 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-274d6422-4a94-46fa-89b0-89e89324e885 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:39.993007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-274d6422-4a94-46fa-89b0-89e89324e885 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:40.000301 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-274d6422-4a94-46fa-89b0-89e89324e885 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1094 microversion: 2.1 time: 0.163868 Oct 12 00:36:40.000975 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 580/1157] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:39 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1094 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:41.023540 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:41.024155 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:41.030240 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:41.030723 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:41.031158 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:41.032381 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:41.032839 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:41.033268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:41.094485 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:41.102217 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-19803ca4-95b6-4560-b8a6-34abf8dd18e5 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1136 microversion: 2.1 time: 0.083432 Oct 12 00:36:41.102780 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 578/1158] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:41 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:42.126664 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:42.127267 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:42.135294 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:42.135889 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:42.136725 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:42.137687 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:42.138221 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:42.138581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:42.159272 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO oslo.messaging._drivers.impl_rabbit [-] [c5750a3d-2a19-445c-b8fc-f1f2883b474d] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60294. Oct 12 00:36:42.208614 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:42.216476 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2bf4b692-1b34-4a23-a93a-68428de5078f tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1210 microversion: 2.1 time: 0.094473 Oct 12 00:36:42.222107 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 581/1159] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:42 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:43.240121 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:43.240738 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:43.247199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:43.257753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:43.257753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:43.257753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:43.257753 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:43.258191 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:43.455180 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:43.462916 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-675d0840-9801-409e-b06f-8a5213b4aa10 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1277 microversion: 2.1 time: 0.226808 Oct 12 00:36:43.463731 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 579/1160] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:43 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:43.974138 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-eb871676-fcea-4b6f-b84d-7930acdff953 req-3e5fba04-639d-4b3a-99c0-af5c94c01533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7bc2077-a6ea-4681-9766-8cbd7f294a57", "tag": "83733852-798e-4fd7-aa73-fd5881794642"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:36:43.984422 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-eb871676-fcea-4b6f-b84d-7930acdff953 req-3e5fba04-639d-4b3a-99c0-af5c94c01533 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:43.985985 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-eb871676-fcea-4b6f-b84d-7930acdff953 req-3e5fba04-639d-4b3a-99c0-af5c94c01533 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:43.986433 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-eb871676-fcea-4b6f-b84d-7930acdff953 req-3e5fba04-639d-4b3a-99c0-af5c94c01533 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:43.997513 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-eb871676-fcea-4b6f-b84d-7930acdff953 req-3e5fba04-639d-4b3a-99c0-af5c94c01533 service nova] Creating event network-changed:83733852-798e-4fd7-aa73-fd5881794642 for instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 on hv-cinder-84914 Oct 12 00:36:44.002417 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-eb871676-fcea-4b6f-b84d-7930acdff953 req-3e5fba04-639d-4b3a-99c0-af5c94c01533 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032006 Oct 12 00:36:44.003291 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 582/1161] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:36:44.485658 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:44.486614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:44.492897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:44.493367 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:44.493792 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:44.494478 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:44.494923 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:44.495336 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:44.710746 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:44.718688 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e75d2362-d305-453b-8fc7-c2a439b87884 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.236974 Oct 12 00:36:44.719264 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 580/1162] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:44 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:45.743207 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:45.743968 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:45.750209 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:45.750691 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:45.751122 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:45.751836 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:45.752290 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:45.752710 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:45.881540 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:45.889110 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0e649fb5-39af-436e-ad22-a34cdb201361 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.150668 Oct 12 00:36:45.889941 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 583/1163] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:45 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:46.965826 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:46.966433 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:46.972812 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:46.973280 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:46.973706 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:46.974381 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:46.974823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:46.975238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:47.104225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:47.112565 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-55fd8d6b-a804-45b9-af73-605b0e716367 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.203530 Oct 12 00:36:47.113126 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 581/1164] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:46 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:48.135201 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:48.135827 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:48.142243 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:48.142658 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:48.143084 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:48.143793 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:48.144238 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:48.144656 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:48.274158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:48.281969 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-68327f1d-a738-43e2-9557-b0792251fa7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.150525 Oct 12 00:36:48.282525 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 584/1165] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:48 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:49.304291 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:49.304901 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:49.311410 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:49.311889 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:49.312321 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:49.313506 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:49.313958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:49.314379 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:49.357582 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=2 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:36:49.379026 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell0:SELECT=6 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:36:49.441067 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:49.448712 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-287220b4-2b64-4617-93f0-92e705287784 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.148254 Oct 12 00:36:49.449290 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 582/1166] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:49 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:50.472655 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:50.473262 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:50.475697 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:36:50.480461 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:50.480921 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:50.481347 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:50.482025 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:50.482480 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:50.482893 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:50.610995 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:50.618773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d6b6e5fc-2406-48a5-ab8e-65a754dcb76d tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.150499 Oct 12 00:36:50.624482 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 585/1167] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:50 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:51.641633 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:51.642185 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:51.649087 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:51.649571 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:51.650008 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:51.650704 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:51.651157 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:51.651636 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:51.782344 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:51.790050 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-63854e42-a9bc-4af7-8792-b8899ebcdef7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.152406 Oct 12 00:36:51.790614 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 583/1168] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:51 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:52.813350 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:52.813911 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:52.820388 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:52.820864 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:52.821295 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:52.821981 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:52.822431 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:52.822851 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:52.949584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:52.957111 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4c58a30c-fd01-4420-bdeb-479b40297547 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.148328 Oct 12 00:36:52.957673 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 586/1169] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:52 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:53.979174 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:53.979813 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:53.986848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:53.987311 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:53.987778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:53.988476 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:53.988929 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:53.989350 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:54.118368 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:54.126734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-e5799e9c-651d-4457-a562-b26dacea5a15 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.151330 Oct 12 00:36:54.127244 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 584/1170] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:53 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:55.149368 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:55.149977 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:55.156430 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:55.156908 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:55.157342 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:55.158030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:55.158481 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:55.158897 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:55.293052 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:55.300945 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ca6494f3-113a-4b3d-b0da-5624d1076238 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.155660 Oct 12 00:36:55.301512 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 587/1171] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:55 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:55.559054 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-b48ea917-bc2f-4648-b538-808456bd5a56 req-9f737691-26f6-43be-b048-25033ca723c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bc2077-a6ea-4681-9766-8cbd7f294a57", "name": "network-vif-plugged", "status": "completed", "tag": "83733852-798e-4fd7-aa73-fd5881794642"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:36:55.569040 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-b48ea917-bc2f-4648-b538-808456bd5a56 req-9f737691-26f6-43be-b048-25033ca723c3 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:55.569505 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-b48ea917-bc2f-4648-b538-808456bd5a56 req-9f737691-26f6-43be-b048-25033ca723c3 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:55.569961 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-b48ea917-bc2f-4648-b538-808456bd5a56 req-9f737691-26f6-43be-b048-25033ca723c3 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:55.581031 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-b48ea917-bc2f-4648-b538-808456bd5a56 req-9f737691-26f6-43be-b048-25033ca723c3 service nova] Creating event network-vif-plugged:83733852-798e-4fd7-aa73-fd5881794642 for instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 on hv-cinder-84914 Oct 12 00:36:55.587237 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-b48ea917-bc2f-4648-b538-808456bd5a56 req-9f737691-26f6-43be-b048-25033ca723c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086893 Oct 12 00:36:55.587873 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 585/1172] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:36:56.324065 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:56.324703 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:56.331637 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:56.336734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:56.336734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:56.336734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:56.336734 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:56.337150 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:56.461287 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:56.469464 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a39e3d5e-d54a-41f5-b5b2-96032e2698b4 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.148718 Oct 12 00:36:56.470023 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 588/1173] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:56 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:57.492803 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:57.493509 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:57.499715 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:57.500193 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:57.500631 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:57.501329 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:57.501785 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:57.502209 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:57.637402 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:57.645066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-bd03a4ff-8323-4c99-98a5-3d6b913d2883 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1265 microversion: 2.1 time: 0.156924 Oct 12 00:36:57.645632 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 586/1174] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:57 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:58.668320 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:58.668866 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:58.675709 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:58.676202 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:58.676632 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:58.677313 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:58.677757 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:58.678182 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:58.808677 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:58.816924 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-deba26c8-683f-4c79-9d06-a549fb503051 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1452 microversion: 2.1 time: 0.152493 Oct 12 00:36:58.817487 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 589/1175] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:58 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:36:58.838734 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:36:58.839385 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:36:58.846254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:58.846722 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:58.847149 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:58.847854 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:36:58.848298 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:36:58.848711 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:36:58.974988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:36:58.982670 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-34b893b6-1a37-4473-b43c-a6b074b0b97e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1452 microversion: 2.1 time: 0.147759 Oct 12 00:36:58.983238 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 587/1176] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:36:58 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:37:00.798088 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-42368c0b-fee7-48e0-93d5-aef93e52abb4 req-38d0abbe-5713-4793-9d4c-b2f1add94503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7bc2077-a6ea-4681-9766-8cbd7f294a57", "tag": "83733852-798e-4fd7-aa73-fd5881794642"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:37:00.807648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-42368c0b-fee7-48e0-93d5-aef93e52abb4 req-38d0abbe-5713-4793-9d4c-b2f1add94503 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:37:00.808123 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-42368c0b-fee7-48e0-93d5-aef93e52abb4 req-38d0abbe-5713-4793-9d4c-b2f1add94503 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:37:00.808545 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-42368c0b-fee7-48e0-93d5-aef93e52abb4 req-38d0abbe-5713-4793-9d4c-b2f1add94503 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:37:00.819319 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-42368c0b-fee7-48e0-93d5-aef93e52abb4 req-38d0abbe-5713-4793-9d4c-b2f1add94503 service nova] Creating event network-changed:83733852-798e-4fd7-aa73-fd5881794642 for instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 on hv-cinder-84914 Oct 12 00:37:00.824264 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-42368c0b-fee7-48e0-93d5-aef93e52abb4 req-38d0abbe-5713-4793-9d4c-b2f1add94503 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030919 Oct 12 00:37:00.824850 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 590/1177] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:38:40.583533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:40.584080 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=24 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:38:40.584458 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:40.585159 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=52 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:38:40.586502 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:38:40.587163 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG dbcounter [-] [125809] Writing DB stats nova_cell1:SELECT=58 {{(pid=125809) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 00:38:40.588452 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 00:38:40.588591 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Wed Oct 12 00:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 (ip 10.222.0.36) !!! Oct 12 00:38:40.603079 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:40.603588 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:40.604021 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:40.604724 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:40.605693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:40.605693 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:40.631432 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Going to try to terminate instance {{(pid=125809) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:38:40.668720 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-7a46fb6d-0208-4b88-b6ae-18e099d93af8 req-0d3da75a-cd1c-42c0-a049-c50c9c0530c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7bc2077-a6ea-4681-9766-8cbd7f294a57", "tag": "83733852-798e-4fd7-aa73-fd5881794642"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:38:40.678465 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7a46fb6d-0208-4b88-b6ae-18e099d93af8 req-0d3da75a-cd1c-42c0-a049-c50c9c0530c2 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:40.678942 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7a46fb6d-0208-4b88-b6ae-18e099d93af8 req-0d3da75a-cd1c-42c0-a049-c50c9c0530c2 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:40.679419 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7a46fb6d-0208-4b88-b6ae-18e099d93af8 req-0d3da75a-cd1c-42c0-a049-c50c9c0530c2 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:40.690583 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-7a46fb6d-0208-4b88-b6ae-18e099d93af8 req-0d3da75a-cd1c-42c0-a049-c50c9c0530c2 service nova] Creating event network-changed:83733852-798e-4fd7-aa73-fd5881794642 for instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 on hv-cinder-84914 Oct 12 00:38:40.695584 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-7a46fb6d-0208-4b88-b6ae-18e099d93af8 req-0d3da75a-cd1c-42c0-a049-c50c9c0530c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114072 Oct 12 00:38:40.696392 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 591/1178] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:38:40.918848 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-5a5db810-035a-43b2-abfd-78d910671676 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 204 len: 0 microversion: 2.1 time: 0.339801 Oct 12 00:38:40.922182 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 588/1179] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:38:40 2022] DELETE /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:38:40.928423 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:40.929126 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:40.935334 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:40.936648 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:40.937282 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:40.938192 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:40.938818 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:40.939228 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:41.072626 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:38:41.081304 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a5f63408-e2d1-41bd-90f1-05040c96cf04 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1577 microversion: 2.1 time: 0.157042 Oct 12 00:38:41.081885 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 592/1180] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:40 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:38:42.105186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:42.105886 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:42.113199 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:42.113675 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:42.114110 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:42.114796 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:42.115249 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:42.115695 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:42.243798 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:38:42.252366 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-71cf42ea-c460-4e5c-b14d-9ae890999c51 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1577 microversion: 2.1 time: 0.151434 Oct 12 00:38:42.252936 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 589/1181] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:42 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:38:43.276028 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:43.276661 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:43.283050 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:43.283563 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:43.289139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:43.289139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:43.289139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:43.289139 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:43.416244 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:38:43.423940 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-88b6a721-4915-4166-a939-ee3f2f86520b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1458 microversion: 2.1 time: 0.152231 Oct 12 00:38:43.424499 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 593/1182] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:43 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1458 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:38:43.591764 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-2e0f245c-8424-4f8f-a284-9eb9eb7802fd req-37ce370e-4e6e-4b6a-a1e9-bfdbc7da28e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7bc2077-a6ea-4681-9766-8cbd7f294a57", "name": "network-vif-deleted", "tag": "83733852-798e-4fd7-aa73-fd5881794642"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:38:43.601815 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2e0f245c-8424-4f8f-a284-9eb9eb7802fd req-37ce370e-4e6e-4b6a-a1e9-bfdbc7da28e6 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:43.602404 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2e0f245c-8424-4f8f-a284-9eb9eb7802fd req-37ce370e-4e6e-4b6a-a1e9-bfdbc7da28e6 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:43.602837 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-2e0f245c-8424-4f8f-a284-9eb9eb7802fd req-37ce370e-4e6e-4b6a-a1e9-bfdbc7da28e6 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:43.613611 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-2e0f245c-8424-4f8f-a284-9eb9eb7802fd req-37ce370e-4e6e-4b6a-a1e9-bfdbc7da28e6 service nova] Creating event network-vif-deleted:83733852-798e-4fd7-aa73-fd5881794642 for instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 on hv-cinder-84914 Oct 12 00:38:43.618744 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-2e0f245c-8424-4f8f-a284-9eb9eb7802fd req-37ce370e-4e6e-4b6a-a1e9-bfdbc7da28e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090623 Oct 12 00:38:43.619353 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 590/1183] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:38:44.446435 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:44.447049 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:44.453635 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:44.454115 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:44.454547 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:44.455239 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:44.455725 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:44.456149 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:44.488702 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:44.489183 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:44.489613 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:44.490053 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lazy-loading 'fault' on Instance uuid c7bc2077-a6ea-4681-9766-8cbd7f294a57 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:38:44.534507 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:38:44.542598 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ca8772c9-2c2f-4dc2-92bf-832a5c639cfd tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 200 len: 1230 microversion: 2.1 time: 0.099706 Oct 12 00:38:44.546961 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 594/1184] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:44 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:38:45.567465 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:45.568172 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c7bc2077-a6ea-4681-9766-8cbd7f294a57] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:45.574356 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:45.574835 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:45.575268 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:45.575983 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:45.577116 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:45.577550 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:45.590625 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] HTTP exception thrown: Instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 could not be found. Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Request method failure captured: Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 HTTP/1.1 Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgrsDWVLFBgChaRU3K_uFCnZt6MBzQQj2iLXaTDzXRyqKOphTMYzAYdjc3RHWavdoDaZDWXNVplfgryetnVYSuUvZMZeGmnFhg_0iWlfQ_aOP9JihMiLSlXHU96QWf7Y-z1GBXFyTimyeD3Ao-YnovLGnsEWfMCiMvQb6A0r2uBm4gw Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:38:45.592254 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_764ed0f4ff5d4c48b89dc4be9460323b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: 828b7770373f4e9688b0f218f7fd6e4f Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 could not be found. Oct 12 00:38:45.594068 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'c7bc2077-a6ea-4681-9766-8cbd7f294a57'} Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 could not be found. Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:38:45.595102 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 could not be found. Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 could not be found. Oct 12 00:38:45.596850 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:45.599066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Returning 404 to user: Instance c7bc2077-a6ea-4681-9766-8cbd7f294a57 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:38:45.599066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-c12720f7-7275-4026-9faa-7b60d2f20928 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57" status: 404 len: 111 microversion: 2.1 time: 0.030944 Oct 12 00:38:45.599066 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 591/1185] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:45 2022] GET /compute/v2.1/servers/c7bc2077-a6ea-4681-9766-8cbd7f294a57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:38:48.903781 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:48.904308 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:48.906645 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [req-3c2b6f11-842c-448b-bad5-373e53d174bb req-6955642f-66c1-4e3d-8fb0-8734f0336d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e94b5bd6-79cb-4441-899f-bc8236b949a5", "tag": "2c050379-d781-411c-bf85-a57395ae94f9"}]} {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:38:48.911774 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:48.912430 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:48.913097 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:48.913791 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:48.914454 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:48.914875 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:48.917909 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-3c2b6f11-842c-448b-bad5-373e53d174bb req-6955642f-66c1-4e3d-8fb0-8734f0336d9a service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:48.918459 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-3c2b6f11-842c-448b-bad5-373e53d174bb req-6955642f-66c1-4e3d-8fb0-8734f0336d9a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:48.918970 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [req-3c2b6f11-842c-448b-bad5-373e53d174bb req-6955642f-66c1-4e3d-8fb0-8734f0336d9a service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:48.930577 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.compute.server_external_events [req-3c2b6f11-842c-448b-bad5-373e53d174bb req-6955642f-66c1-4e3d-8fb0-8734f0336d9a service nova] Creating event network-changed:2c050379-d781-411c-bf85-a57395ae94f9 for instance e94b5bd6-79cb-4441-899f-bc8236b949a5 on hv-cinder-84914 Oct 12 00:38:48.936339 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [req-3c2b6f11-842c-448b-bad5-373e53d174bb req-6955642f-66c1-4e3d-8fb0-8734f0336d9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 Oct 12 00:38:48.937486 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 592/1186] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 00:38:48.942429 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 00:38:49.235902 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bc2194c7-53f8-46ee-bfde-9e3615fb6965 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 204 len: 0 microversion: 2.1 time: 0.334876 Oct 12 00:38:49.236500 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 595/1187] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:38:48 2022] DELETE /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 00:38:49.246175 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:49.246977 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:49.253992 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:49.254479 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:49.254914 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:49.255651 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:49.256104 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:49.256533 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:49.391017 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:38:49.398958 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-83356511-7eb2-4ac7-a819-1befda90a0d9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1578 microversion: 2.1 time: 0.157767 Oct 12 00:38:49.399544 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 593/1188] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:49 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:38:50.423107 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:50.423869 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:50.430197 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:50.430678 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:50.431113 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:50.431842 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:50.432296 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:50.432724 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:50.564506 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:38:50.573007 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-094fc98c-969e-47aa-b0be-d52fa885943b tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1578 microversion: 2.1 time: 0.154106 Oct 12 00:38:50.573579 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 596/1189] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:50 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:38:51.597368 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:51.600903 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:51.604524 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:51.605009 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:51.605418 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:51.606103 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:51.606534 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:51.606988 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:51.696843 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:38:51.697140 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-298b4a3f-84fc-44da-b9af-8957fe0b8fc8 req-5e677ec1-a8ac-4ba4-8b71-61517e3eb800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e94b5bd6-79cb-4441-899f-bc8236b949a5", "name": "network-vif-deleted", "tag": "2c050379-d781-411c-bf85-a57395ae94f9"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 00:38:51.705311 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-1d8c67b2-04e2-406c-b3cd-be68e7de5de8 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1392 microversion: 2.1 time: 0.111872 Oct 12 00:38:51.709500 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 594/1190] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:51 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1392 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 00:38:51.709644 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-298b4a3f-84fc-44da-b9af-8957fe0b8fc8 req-5e677ec1-a8ac-4ba4-8b71-61517e3eb800 service nova] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:51.709644 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-298b4a3f-84fc-44da-b9af-8957fe0b8fc8 req-5e677ec1-a8ac-4ba4-8b71-61517e3eb800 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:51.709644 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-298b4a3f-84fc-44da-b9af-8957fe0b8fc8 req-5e677ec1-a8ac-4ba4-8b71-61517e3eb800 service nova] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:51.720788 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-298b4a3f-84fc-44da-b9af-8957fe0b8fc8 req-5e677ec1-a8ac-4ba4-8b71-61517e3eb800 service nova] Creating event network-vif-deleted:2c050379-d781-411c-bf85-a57395ae94f9 for instance e94b5bd6-79cb-4441-899f-bc8236b949a5 on hv-cinder-84914 Oct 12 00:38:51.725813 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-298b4a3f-84fc-44da-b9af-8957fe0b8fc8 req-5e677ec1-a8ac-4ba4-8b71-61517e3eb800 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032374 Oct 12 00:38:51.726386 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 597/1191] 10.222.0.36 () {64 vars in 1317 bytes} [Wed Oct 12 00:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 00:38:52.728370 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:52.729003 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:52.735884 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:52.736352 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:52.736777 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:52.737456 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:52.737897 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:52.738312 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:52.769077 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:52.769543 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:52.769969 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:52.770411 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.objects.instance [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lazy-loading 'fault' on Instance uuid e94b5bd6-79cb-4441-899f-bc8236b949a5 {{(pid=125809) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 00:38:52.810827 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.policy [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828b7770373f4e9688b0f218f7fd6e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '764ed0f4ff5d4c48b89dc4be9460323b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125809) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 00:38:52.818558 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-9ab1dc0b-dee3-4c48-b1a0-eb16912d26a7 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 200 len: 1230 microversion: 2.1 time: 0.093991 Oct 12 00:38:52.819128 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 595/1192] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:52 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 00:38:53.842581 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:53.843317 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: e94b5bd6-79cb-4441-899f-bc8236b949a5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:53.849431 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:53.849909 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:53.850343 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:53.851031 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:53.851548 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:53.851972 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:53.865093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] HTTP exception thrown: Instance e94b5bd6-79cb-4441-899f-bc8236b949a5 could not be found. Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Request method failure captured: Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 HTTP/1.1 Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgrsDWVLFBgChaRU3K_uFCnZt6MBzQQj2iLXaTDzXRyqKOphTMYzAYdjc3RHWavdoDaZDWXNVplfgryetnVYSuUvZMZeGmnFhg_0iWlfQ_aOP9JihMiLSlXHU96QWf7Y-z1GBXFyTimyeD3Ao-YnovLGnsEWfMCiMvQb6A0r2uBm4gw Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:38:53.866662 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_764ed0f4ff5d4c48b89dc4be9460323b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: 828b7770373f4e9688b0f218f7fd6e4f Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance e94b5bd6-79cb-4441-899f-bc8236b949a5 could not be found. Oct 12 00:38:53.868606 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'e94b5bd6-79cb-4441-899f-bc8236b949a5'} Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e94b5bd6-79cb-4441-899f-bc8236b949a5 could not be found. Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:38:53.869610 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e94b5bd6-79cb-4441-899f-bc8236b949a5 could not be found. Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e94b5bd6-79cb-4441-899f-bc8236b949a5 could not be found. Oct 12 00:38:53.870928 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:53.872773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Returning 404 to user: Instance e94b5bd6-79cb-4441-899f-bc8236b949a5 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:38:53.872773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5586e97f-32b0-4e8f-9386-4a5f478c9f3e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5" status: 404 len: 111 microversion: 2.1 time: 0.030187 Oct 12 00:38:53.872773 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 598/1193] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:53 2022] GET /compute/v2.1/servers/e94b5bd6-79cb-4441-899f-bc8236b949a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:38:54.376536 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:54.377043 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.compute.api [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125809) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:54.383316 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:54.383829 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:54.384265 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:54.384953 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:54.385398 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:54.385823 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG oslo_concurrency.lockutils [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125809) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:54.399082 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.wsgi [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] HTTP exception thrown: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Request method failure captured: Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: request: DELETE /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 HTTP/1.1 Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept: application/json Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Accept-Encoding: identity Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Connection: close Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Length: 0 Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Content-Type: application/json Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Host: 10.222.0.36 Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: Openstack-System-Scope: None Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: User-Agent: python-urllib3/1.26.12 Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Auth-Token: gAAAAABjRgrsDWVLFBgChaRU3K_uFCnZt6MBzQQj2iLXaTDzXRyqKOphTMYzAYdjc3RHWavdoDaZDWXNVplfgryetnVYSuUvZMZeGmnFhg_0iWlfQ_aOP9JihMiLSlXHU96QWf7Y-z1GBXFyTimyeD3Ao-YnovLGnsEWfMCiMvQb6A0r2uBm4gw Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Id: None Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Domain-Name: None Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Identity-Status: Confirmed Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Is-Admin-Project: True Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Id: default Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Domain-Name: Default Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Project-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Role: member,reader Oct 12 00:38:54.400778 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Roles: member,reader Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_764ed0f4ff5d4c48b89dc4be9460323b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Id: default Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Domain-Name: Default Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Id: 828b7770373f4e9688b0f218f7fd6e4f Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: X-User-Name: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: method: > Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: exception: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.402491 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: action_args: {'id': 'c50686e7-ef13-42ad-b479-ae1326018ba4'} Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:38:54.403494 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.405574 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.407186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Returning 404 to user: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. {{(pid=125809) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:38:54.407186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-0a25aaab-aaca-45bb-8d7d-a9ca74fd8cd1 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 404 len: 111 microversion: 2.1 time: 0.029583 Oct 12 00:38:54.407186 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 596/1194] 10.222.0.36 () {58 vars in 1239 bytes} [Wed Oct 12 00:38:54 2022] DELETE /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:38:54.411093 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:54.411742 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] [instance: c50686e7-ef13-42ad-b479-ae1326018ba4] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 00:38:54.417683 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:54.418158 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:54.418590 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:54.419275 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Acquiring lock "2b25f271-a621-44c9-82e0-2017e2b25b27" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 00:38:54.419761 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 00:38:54.420826 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Lock "2b25f271-a621-44c9-82e0-2017e2b25b27" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 00:38:54.433947 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] HTTP exception thrown: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Request method failure captured: Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 HTTP/1.1 Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Connection: close Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Host: 10.222.0.36 Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjRgrsDWVLFBgChaRU3K_uFCnZt6MBzQQj2iLXaTDzXRyqKOphTMYzAYdjc3RHWavdoDaZDWXNVplfgryetnVYSuUvZMZeGmnFhg_0iWlfQ_aOP9JihMiLSlXHU96QWf7Y-z1GBXFyTimyeD3Ao-YnovLGnsEWfMCiMvQb6A0r2uBm4gw Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Role: member,reader Oct 12 00:38:54.435441 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Roles: member,reader Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_764ed0f4ff5d4c48b89dc4be9460323b", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/764ed0f4ff5d4c48b89dc4be9460323b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}] Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 764ed0f4ff5d4c48b89dc4be9460323b Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-TestVolumeBootPattern-1489127995 Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Id: 828b7770373f4e9688b0f218f7fd6e4f Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-TestVolumeBootPattern-1489127995-project Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: method: > Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: exception: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.437101 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: action_args: {'id': 'c50686e7-ef13-42ad-b479-ae1326018ba4'} Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 00:38:54.438030 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. Oct 12 00:38:54.439596 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 12 00:38:54.441002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Returning 404 to user: Instance c50686e7-ef13-42ad-b479-ae1326018ba4 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 00:38:54.441002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b3e2775f-9020-46ae-8995-656cf8b15cb9 tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4" status: 404 len: 111 microversion: 2.1 time: 0.029570 Oct 12 00:38:54.441002 dv-cinder-849143-13-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 599/1195] 10.222.0.36 () {58 vars in 1236 bytes} [Wed Oct 12 00:38:54 2022] GET /compute/v2.1/servers/c50686e7-ef13-42ad-b479-ae1326018ba4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 00:38:55.968225 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: DEBUG nova.api.openstack.wsgi [None req-d56a2c98-e723-419b-8368-e4519ea31e7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] Calling method '.version_select at 0x7f2fe92a9d30>' {{(pid=125809) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 00:38:56.052807 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: INFO nova.api.openstack.requestlog [None req-d56a2c98-e723-419b-8368-e4519ea31e7e tempest-TestVolumeBootPattern-1489127995 tempest-TestVolumeBootPattern-1489127995-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1182794385" status: 202 len: 0 microversion: 2.1 time: 0.088821 Oct 12 00:38:56.053380 dv-cinder-849143-13-iscsi devstack@n-api.service[125809]: [pid: 125809|app: 0|req: 597/1196] 10.222.0.36 () {58 vars in 1263 bytes} [Wed Oct 12 00:38:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1182794385 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)